-- Logs begin at Mon 2022-10-24 12:34:06 UTC, end at Mon 2022-10-24 13:51:13 UTC. -- Oct 24 13:16:36.239910 dv-cinder-862491-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 24 13:16:36.250272 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 24 13:16:36.252861 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 24 13:16:36 2022] *** Oct 24 13:16:36.252861 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 24 13:16:36.252861 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 24 13:16:36.252861 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: nodename: dv-cinder-862491-1-iscsi Oct 24 13:16:36.252861 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: machine: x86_64 Oct 24 13:16:36.252861 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: clock source: unix Oct 24 13:16:36.252861 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: pcre jit disabled Oct 24 13:16:36.252861 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: detected number of CPU cores: 4 Oct 24 13:16:36.252861 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: current working directory: / Oct 24 13:16:36.252861 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: detected binary path: /usr/bin/uwsgi-core Oct 24 13:16:36.252861 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: your processes number limit is 47680 Oct 24 13:16:36.253664 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: your memory page size is 4096 bytes Oct 24 13:16:36.253664 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: detected max file descriptor number: 2048 Oct 24 13:16:36.253664 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: lock engine: pthread robust mutexes Oct 24 13:16:36.253664 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: thunder lock: enabled Oct 24 13:16:36.253664 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 24 13:16:36.253664 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 24 13:16:36.292176 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: Python main interpreter initialized at 0x5569c97be9c0 Oct 24 13:16:36.292176 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: python threads support enabled Oct 24 13:16:36.292176 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: your server socket listen backlog is limited to 100 connections Oct 24 13:16:36.292176 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: your mercy for graceful operations on workers is 90 seconds Oct 24 13:16:36.292524 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: mapped 403077 bytes (393 KB) for 2 cores Oct 24 13:16:36.292599 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: *** Operational MODE: preforking *** Oct 24 13:16:36.292853 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: *** uWSGI is running in multiple interpreter mode *** Oct 24 13:16:36.292853 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: spawned uWSGI master process (pid: 104123) Oct 24 13:16:36.293019 dv-cinder-862491-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 24 13:16:36.294822 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: spawned uWSGI worker 1 (pid: 104124, cores: 1) Oct 24 13:16:36.294822 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: spawned uWSGI worker 2 (pid: 104125, cores: 1) Oct 24 13:16:36.294822 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 24 13:16:36.942935 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 13:16:36.943960 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 13:16:38.010242 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:16:38.010242 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: from cryptography.utils import int_from_bytes Oct 24 13:16:38.010869 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:16:38.010869 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: from cryptography.utils import int_from_bytes Oct 24 13:16:38.011850 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:16:38.011850 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: from cryptography.utils import int_from_bytes Oct 24 13:16:38.012293 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:16:38.012293 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: from cryptography.utils import int_from_bytes Oct 24 13:16:40.479887 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 13:16:40.480478 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 13:16:40.480683 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 13:16:40.481034 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 13:16:40.481288 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 13:16:40.481663 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 13:16:40.481755 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 13:16:40.481843 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.481968 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.482065 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 13:16:40.482282 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.482411 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 13:16:40.482593 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.482692 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 13:16:40.482915 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.483020 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.483223 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.483353 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.483532 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.483673 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.483845 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.483993 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.484165 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.484343 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.484450 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.484655 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.484757 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.484980 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.485087 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862491-1-iscsi {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.485296 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.485391 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.485622 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.485718 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.485881 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.485977 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.486197 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.486292 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.486508 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.486611 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862491-1-iscsi {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.486823 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.486910 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.487122 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.487217 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.487429 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.487612 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.488024 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.488024 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.488179 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.488362 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.488470 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.488668 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.488762 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.488994 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.489172 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.489340 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.489481 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.489596 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.489785 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.489911 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.490092 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.490201 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.490423 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.490517 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.490733 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.490837 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.491038 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.491171 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862491-1-iscsi {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.491353 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.491534 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.492196 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.492342 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.492544 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.492640 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.492852 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.493043 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.493299 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862491-1-iscsi {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.493409 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.493561 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.493657 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.493872 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.493970 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.494182 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.494277 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.494530 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.494625 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.494849 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.494938 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.495164 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.495263 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.495476 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.495576 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.495788 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.495882 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.496083 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.496187 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.496413 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.496516 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.496716 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.496808 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.497028 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.497130 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.497328 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.497423 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.497628 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.497723 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.497873 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.497974 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.498172 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.498260 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.498489 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.498597 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.498803 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.498903 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.499107 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.499206 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.499357 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.499456 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.499601 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.499690 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.499912 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.500007 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.500225 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.500346 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.500557 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.500653 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.500840 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.500930 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.501088 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.501186 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.501403 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.501499 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.501721 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.501811 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.502020 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.502119 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.502319 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.502415 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.502620 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.502714 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.502921 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.503018 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.503230 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.503325 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.503535 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.503634 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.503837 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.503934 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.504137 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.504231 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.504477 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.504567 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.504784 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.504879 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.505086 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.505227 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.505391 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.505486 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.505707 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.505796 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.506010 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.506104 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.506323 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.506413 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.506631 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.506769 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.506929 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.507024 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.507253 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.507354 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.507550 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.507649 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.507863 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.507953 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.508187 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.508320 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.508514 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.508658 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.508761 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.508847 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.509041 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.509172 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.509346 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.509443 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.509656 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.509753 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.509957 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.510065 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.510248 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.510351 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.510548 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.510651 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.510843 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.510940 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.511142 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.511239 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.511441 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.511545 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.511742 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.511838 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.512040 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.512142 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.512360 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.512469 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.512658 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.512753 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.512956 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.513046 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.513255 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.513351 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.513558 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.513664 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.513852 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.513940 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.514151 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.514240 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.514455 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.514546 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.514752 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.514839 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.515050 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.515148 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.515350 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.515451 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.515646 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.515735 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.515960 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.516055 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.516262 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.516386 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.516584 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.516672 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.516888 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.516987 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.517189 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.517279 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.517508 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.517604 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.517814 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.517903 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.518114 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.518203 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.518416 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.518514 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.518720 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.518817 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.519016 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.519103 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.519323 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.519411 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.519625 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.519722 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.519925 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.520013 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.520226 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.520335 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.520547 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.520649 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.520847 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.520936 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.521146 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.521235 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.521445 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.521542 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.521743 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.521832 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.522042 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.522130 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.522337 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.522432 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.522655 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.522744 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.522973 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.523068 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.523278 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.523367 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.523646 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.523755 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.523877 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.523965 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.524190 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.524446 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.524540 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.524621 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.524827 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.524917 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.525133 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.525223 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.525442 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.525599 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.525743 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:16:40.525894 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.526077 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.526225 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.526404 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.526542 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.526713 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.526860 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.527010 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.527157 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.527329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.527468 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.527637 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.527802 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.527946 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.528085 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.528221 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.528345 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.528560 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.528650 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.528878 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.528978 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.529201 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.529291 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.529535 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.529640 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.529805 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.529904 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.530114 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.530202 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.530421 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.530525 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.530735 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.530823 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.531045 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.531144 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.531357 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.531445 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.531662 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.531751 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.531968 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.532057 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.532303 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.532414 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.532632 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.532732 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.532949 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.533060 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.533261 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.533366 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.533564 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.533660 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.533869 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.533967 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.534174 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.534319 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.534504 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.534654 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.534811 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.534958 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.535117 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.535255 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.535423 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.535605 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.535750 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.535904 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.536042 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.536177 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.536326 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.536461 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.536633 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.536789 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.536927 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.537139 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.537280 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.537417 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.537554 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.537698 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.537847 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.537990 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.538126 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.538760 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.538959 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.539101 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.539275 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.539434 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.539568 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.539703 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.539883 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.540022 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.540189 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.540386 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.540522 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.540609 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.540809 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.540900 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.541108 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.541197 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.541407 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.541496 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.541706 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.541796 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.542011 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.542100 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.542310 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.542406 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.542612 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.542701 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.542915 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.543003 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.543214 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.543310 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.543520 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.543616 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.543822 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.543957 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.544125 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.544222 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.544454 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.544545 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.544761 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.544851 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.545062 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.545160 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.545368 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.545457 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.545670 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.545759 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.545972 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.546068 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.546277 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.546367 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.546579 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.546666 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.546880 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.546976 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.547190 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.547303 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.547485 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.547583 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.547785 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.547875 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.548093 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.548182 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.548422 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.548516 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.548730 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.548827 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.549038 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.549197 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.549338 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.549475 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.549643 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.549783 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.549931 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.550067 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.550237 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.550385 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.550543 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.550681 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.550846 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.550986 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.551158 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.551304 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.551468 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.551614 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.551779 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.551928 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.552077 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.552225 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.552377 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.552522 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.552663 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.552799 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.553016 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.553154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.553292 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.553428 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.553564 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.553706 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.553864 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.554556 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.554713 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.554851 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.554993 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.555130 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.555276 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.555435 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.555574 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.555741 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.555881 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.556050 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.556207 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.556398 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.556542 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.556680 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.556817 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.556953 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.557101 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.557257 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.557402 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.557540 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.557629 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.557859 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.557948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.558169 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.558258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.558474 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.558563 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.558780 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.558870 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.559084 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.559213 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.559422 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.559510 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.559724 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.559821 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.560029 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.560116 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.560356 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.560449 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.560663 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.560759 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.560970 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.561059 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.561285 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.561382 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.561593 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.561689 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.561950 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.562050 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.562211 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.562310 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.562518 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.562606 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.562822 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.562910 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.563137 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.563239 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.563438 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.563527 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.563747 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.563835 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.564052 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.564148 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.564397 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.564489 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.564710 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.564800 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.565023 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.565111 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.565324 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.565411 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.565631 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.565719 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.565936 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.566025 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.566241 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.566330 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.566544 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.566632 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.566849 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.566946 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.567161 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.567257 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.567465 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.567553 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.567771 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.567860 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.568072 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.568159 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.568400 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.568502 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.568706 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.568804 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.569019 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.569107 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.569322 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.569427 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.569660 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.569757 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.569970 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.570059 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.570289 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.570387 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.570592 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.570679 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.570902 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.571000 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.571201 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.571301 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.571509 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.571604 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.571815 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.571910 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.572121 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.572219 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.572445 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.572535 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.572749 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.572847 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.573054 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.573151 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.573363 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.573451 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.573667 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.573764 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.573970 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.574060 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.574268 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.574356 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.574570 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.574657 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.574869 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.574957 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.575167 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.575263 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.575465 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.575553 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.575767 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.575856 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.576068 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.576155 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.576392 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.576495 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.576698 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.576794 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.576999 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.577089 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.577297 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.577393 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.577596 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.577737 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.577909 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.578050 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.578212 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.578626 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.578782 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.578918 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.579071 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.579210 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.579351 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.579509 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.579647 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.579789 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.579930 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.580078 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.580222 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.580405 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.580543 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.580690 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.580838 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.580982 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.581077 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.581159 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.581240 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.581320 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.581468 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.581558 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.581772 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.581864 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.582087 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.582183 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.582395 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.582492 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.582699 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.582789 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.583004 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.583092 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.583309 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.583405 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.583614 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.583702 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.583915 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.584002 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.584230 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.584398 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.584558 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.584647 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.584864 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.584953 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.585192 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.585292 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.585492 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.585597 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.585797 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.585887 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.586107 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.586208 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.586413 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.586668 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.586758 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.587000 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.587097 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.587303 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.587405 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.587610 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.587699 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.587924 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.588025 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.588248 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.588508 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.588599 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.588841 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.589233 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.589407 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.589541 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.589725 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.589814 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.590047 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.590136 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.590349 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.590447 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.590649 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.590739 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.590958 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.591047 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.591260 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.591348 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.591562 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.591658 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.591863 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.591958 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.592168 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.592256 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.592490 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.592579 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.592790 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.592887 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.593090 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.593179 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.593391 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.593481 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.593692 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.593780 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.593988 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.594083 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.594287 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.594376 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.594585 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.594682 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.594885 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.594983 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.595189 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.595284 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.595486 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.595574 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.595786 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.595886 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.596082 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.596171 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.596405 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.596499 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.596729 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.596831 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.597039 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.597128 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.597342 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.597430 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.597647 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.597785 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.597950 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.598039 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.598257 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.598346 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.598577 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.598666 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.598877 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.598965 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.599177 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.599266 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.599479 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.599569 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.599782 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.599870 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.600084 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.600182 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.600404 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.600495 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.600712 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.601304 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.601527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.601634 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.601832 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.601921 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.602136 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.602224 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.602435 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.602533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.602738 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.602826 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.603035 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.603132 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.603344 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.603442 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.603646 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.603736 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.603943 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.604031 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.604241 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.604391 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.604570 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.604660 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.604872 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.604972 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.605167 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.605255 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.605471 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.605560 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.605769 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.605859 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.606068 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.606159 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.606364 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.606451 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.606664 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.606752 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.606962 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.607050 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.607263 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.607350 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.607561 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.607668 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.607908 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.608007 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.608166 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.608254 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.608493 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.608594 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.608794 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.608883 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.609093 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.609181 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.609396 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.609497 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.609692 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.609779 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.609989 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.610076 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.610292 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.610389 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.610592 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.610681 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.610896 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.610986 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.611193 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.611289 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.611494 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.611589 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.611789 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.611877 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.612089 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.612179 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.612415 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.612508 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.612718 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.612807 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.613015 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.613106 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.613312 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.613400 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.613608 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.613696 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.613906 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.613996 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.614203 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.614298 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.614507 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.614596 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.614808 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.614910 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.615104 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.615192 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.615401 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.615499 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.615697 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.615786 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.615994 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.616082 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.616335 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.616483 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.617187 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.617282 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.617492 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.617581 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.617797 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.617937 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.618098 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.618186 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.618403 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.618490 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.618712 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.618814 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.619022 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.619118 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.619329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.619418 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.619640 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.619729 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.619947 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.620039 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.620255 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.620384 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.620644 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.620733 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.620944 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.621041 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.621247 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.621334 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.621554 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.621641 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.621858 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.621953 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.622169 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.622257 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.622471 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.622561 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.622773 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.622861 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.623074 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.623161 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.623382 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.623472 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.623687 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.623775 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.623993 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.624093 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.624321 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.624413 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.624629 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.624717 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.624935 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.625050 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.625242 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.625400 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.625547 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.625636 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.625850 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.625948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.626155 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.626250 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.626457 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.626546 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.626761 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.626859 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.627065 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.627153 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.627365 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.627453 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.627673 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.627769 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.627976 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.628063 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.628290 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.628380 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.628599 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.628690 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.628900 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.628988 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.629200 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.629294 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.629499 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.629587 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.629817 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.629943 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.630121 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.630210 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.630428 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.630518 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.630731 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.630827 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.631038 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.631136 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.631340 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.631429 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.631663 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.631750 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.631973 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.632090 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.632319 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.632424 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.632709 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.632797 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.633021 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.633119 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.633326 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.633422 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.633633 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.633723 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.633934 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.634033 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.634234 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.634324 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.634539 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.634649 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.634858 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.634948 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.635158 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.635253 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.635457 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.635545 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.635758 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.635848 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.636074 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.636163 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.636401 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.636504 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.636719 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.636809 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.637047 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.637135 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.637351 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.637440 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.637655 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.637745 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.637973 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.638102 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.638277 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.638408 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.638595 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.638712 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.639005 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.639094 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.639316 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.639412 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.639618 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.639732 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.639933 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.640059 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.640242 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.640346 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.640566 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.640667 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.640882 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.640972 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.641200 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.641290 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.641504 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.641601 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.641812 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.641910 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.642112 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.642200 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.642427 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.642526 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.642744 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.642841 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.643051 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.643140 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.643365 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.643461 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.643676 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.643773 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.643979 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.644068 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.644314 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.644425 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.644637 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.644727 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.644950 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.645046 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.645272 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.645364 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.645572 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.645683 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.645876 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.646005 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.646176 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.646312 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.646478 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.646629 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.646794 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.646952 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.647093 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.647256 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.647398 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.647560 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.648237 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.648410 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.648568 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.648712 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.648871 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.649016 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.649171 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.649336 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.649491 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.649645 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.649791 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.649954 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.650111 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.650282 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.650419 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.650569 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.650732 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.650866 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.651011 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.651148 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.651305 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.651444 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.651621 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.651761 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.651929 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.652077 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.652224 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.652349 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.652584 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.652674 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.652883 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.652980 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.653217 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.653308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.653517 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.653615 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.653830 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.653928 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.654154 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.654242 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.654454 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.654551 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.654754 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.654844 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.655078 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.655166 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.655380 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.655478 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.655696 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.655785 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.655997 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.656087 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.656327 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.656435 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.656645 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.656735 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.656943 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.657033 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.657241 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.657331 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.657541 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.657640 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.657838 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.657927 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.658136 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.658226 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.658435 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.658523 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.658734 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.658823 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.659030 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.659127 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.659331 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.659420 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.659627 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.659725 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.659927 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.660017 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.660223 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.660325 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.660563 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.660660 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.660859 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.660957 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.661155 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.661243 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.661452 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.661557 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.661748 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.661836 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.662056 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.662149 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.662367 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.662471 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.662668 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.662757 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.662970 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.663075 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.663319 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.663916 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.664121 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.664211 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.664455 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.664545 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.664768 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.664859 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.665080 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.665169 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.665386 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.665483 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.665693 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.665783 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.666002 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.666091 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.666306 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.666395 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.666616 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.666706 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.666924 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.667026 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.667236 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.667325 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.667551 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.667744 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.667864 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.668065 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.668155 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.668397 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.668503 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.668707 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.668797 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.669013 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.669102 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.669327 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.669594 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.669684 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.669918 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.670008 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.670224 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.670321 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.670529 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.670626 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.670834 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.670931 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.671145 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.671243 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.671455 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.671551 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.671762 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.671852 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.672069 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.672199 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.672401 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.672492 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.672709 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.672801 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.673019 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.673115 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.673328 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.673425 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.673656 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.673751 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.673971 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.674061 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.674273 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.674362 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.674582 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.674743 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.674893 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.674982 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.675199 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.675284 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.675505 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.675611 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.675811 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.675902 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.676122 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.676223 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.676455 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.676546 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.676763 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.676854 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.677070 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.677159 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.677377 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.677474 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.677683 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.677772 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.677994 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.678096 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.678306 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.678396 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.678616 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.678705 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.678946 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.679046 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.679256 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.679345 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.679565 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.679652 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.679883 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.680076 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.680215 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.680409 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.680580 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.680740 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.680874 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.681061 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.681152 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.681380 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.681469 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.681691 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.681956 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.682046 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.682274 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.682364 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.682596 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.682684 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.682898 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.682988 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.683205 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.683310 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.683509 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.683598 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.683808 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.683906 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.684122 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.684224 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.684449 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.684540 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.684750 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.684841 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.685063 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.685152 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.685366 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.685464 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.685669 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.685887 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.685977 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.686222 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.686311 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.686534 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.686624 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.686856 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.686945 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.687163 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.687252 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.687472 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.687691 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.687781 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.688027 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.688116 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.688367 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.688462 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.688676 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.688764 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.688989 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.689078 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.689299 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.689390 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.689599 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.689688 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.689898 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.689987 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.690202 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.690293 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.690504 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.690654 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.690802 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.690891 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.691106 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.691197 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.691403 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.691492 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.691702 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.691799 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.692008 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.692097 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.692324 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.692417 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.692627 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.692734 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.692930 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.693020 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.693229 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.693330 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.693527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.693629 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.693826 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.693915 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.694120 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.694209 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.694420 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.694537 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.694740 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.694836 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.695043 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.695133 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.695342 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.695432 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.695642 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.695740 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.695940 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.696029 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.696249 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.696380 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.696573 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.696662 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.696881 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.696971 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.697177 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.697268 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.697476 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.697566 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.697787 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.697876 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.698092 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.698183 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.698400 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.698489 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.698703 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.698791 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.699009 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.699107 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.699308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.699403 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.699622 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.699722 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.699931 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.700155 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.700244 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.700504 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.700594 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.700821 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.700926 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.701145 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.701236 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.701467 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.701557 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.701770 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.702019 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.702111 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.702352 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.702442 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.702668 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.702764 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.702972 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.703062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.703277 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.703366 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.703581 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.703720 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.703885 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.703982 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.704188 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.704308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.704513 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.704604 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.704816 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.704905 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.705117 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.705215 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.705420 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.705510 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.705722 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.705875 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.706024 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.706124 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.706328 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.706418 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.706633 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.706722 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.706932 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.707033 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.707237 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.707327 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.707542 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.707633 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.707850 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.707955 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.708156 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.708246 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.708486 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.708575 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.708792 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.708882 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.709094 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.709182 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.709405 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.709495 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.709708 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.709799 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.710009 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.710098 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.710834 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.710931 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.711147 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.711244 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.711454 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.711550 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.711755 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.711852 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.712058 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.712389 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.712482 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.712705 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.712799 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.713022 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.713111 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.713331 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.713419 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.713638 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.713726 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.714214 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.714533 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.714632 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.714841 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.714931 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.715160 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.715250 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.715467 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.715556 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.715782 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.715867 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.716107 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.716197 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.716449 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.716540 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.716763 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.716852 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.717065 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.717155 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.717366 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.717455 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.717664 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.717771 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.717968 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.718057 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.718281 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.718377 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.718587 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.718689 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.718886 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.718982 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.719185 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.719275 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.719490 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.719587 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.719794 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.719883 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.720093 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.720181 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.720412 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.720517 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.720714 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.720854 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.721015 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.721108 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.721312 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.721402 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.721609 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.721698 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.721906 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.721995 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.722203 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.722300 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.722499 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.722588 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.722797 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.722896 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.723098 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.723196 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.723394 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.723525 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.723693 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.723783 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.723990 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.724090 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.724334 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.724428 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.724610 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.724712 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.724914 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.725004 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.725219 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.725309 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.725524 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.725627 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.726413 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.726515 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.726679 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.726769 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.726981 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.727081 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.727285 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.727375 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.727600 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.727696 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.727916 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.728014 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.728225 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.728347 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.728552 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.728643 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.728872 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.728962 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.729174 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.729263 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.729478 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.729576 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.729789 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.729887 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.730138 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.730233 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.730398 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.730489 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.730701 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.730791 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.731018 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.731111 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.731324 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.731427 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.731622 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.731711 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.731929 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.732030 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.732235 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.732364 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.732566 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.732655 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.732874 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.732971 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.733177 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.733343 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.733568 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.733668 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.733796 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.733886 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.734098 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.734189 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.734400 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.734497 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.734705 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.734795 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.735007 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.735097 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.735313 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.735411 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.735617 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.735707 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.735919 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.736010 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.736228 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.736348 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.736559 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.736658 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.736867 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.736963 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.737184 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.737275 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.737484 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.737582 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.737792 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.737881 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.738108 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.738197 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.738423 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.738526 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.738737 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.738829 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.739059 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.739149 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.739368 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.739474 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.739676 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.739765 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.739987 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.740076 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.740313 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.740407 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.740548 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 13:16:40.740639 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.740988 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.741312 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.741651 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.741962 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.742266 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:16:40.742509 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 13:16:40.893095 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO dbcounter [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] Registered counter for database nova_api Oct 24 13:16:40.894712 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO dbcounter [None req-6b422dbd-838c-49ca-8c61-eb9f4c1b6564 None None] Registered counter for database nova_api Oct 24 13:16:40.914913 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_db.sqlalchemy.engines [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:16:40.916556 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG oslo_db.sqlalchemy.engines [None req-6b422dbd-838c-49ca-8c61-eb9f4c1b6564 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:16:40.921750 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG dbcounter [-] [104125] Writer thread running {{(pid=104125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:16:40.923087 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG dbcounter [-] [104124] Writer thread running {{(pid=104124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:16:40.978528 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.context [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),12340954-03b2-46f2-a6e0-59bc7b2721c7(cell1) {{(pid=104125) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 13:16:40.979839 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.context [None req-6b422dbd-838c-49ca-8c61-eb9f4c1b6564 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),12340954-03b2-46f2-a6e0-59bc7b2721c7(cell1) {{(pid=104124) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 13:16:40.982412 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:40.982836 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:40.983649 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG oslo_concurrency.lockutils [None req-6b422dbd-838c-49ca-8c61-eb9f4c1b6564 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:40.984124 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG oslo_concurrency.lockutils [None req-6b422dbd-838c-49ca-8c61-eb9f4c1b6564 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:40.984435 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:40.985141 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:40.985583 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:40.985718 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG oslo_concurrency.lockutils [None req-6b422dbd-838c-49ca-8c61-eb9f4c1b6564 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:40.986432 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG oslo_concurrency.lockutils [None req-6b422dbd-838c-49ca-8c61-eb9f4c1b6564 None None] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:40.986876 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG oslo_concurrency.lockutils [None req-6b422dbd-838c-49ca-8c61-eb9f4c1b6564 None None] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:40.987552 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:40.988887 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG oslo_concurrency.lockutils [None req-6b422dbd-838c-49ca-8c61-eb9f4c1b6564 None None] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:40.989564 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO dbcounter [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] Registered counter for database nova_cell0 Oct 24 13:16:40.990870 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO dbcounter [None req-6b422dbd-838c-49ca-8c61-eb9f4c1b6564 None None] Registered counter for database nova_cell0 Oct 24 13:16:40.994262 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO dbcounter [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] Registered counter for database nova_cell1 Oct 24 13:16:40.995414 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO dbcounter [None req-6b422dbd-838c-49ca-8c61-eb9f4c1b6564 None None] Registered counter for database nova_cell1 Oct 24 13:16:41.001554 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_db.sqlalchemy.engines [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:16:41.003220 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_db.sqlalchemy.engines [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:16:41.005221 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG oslo_db.sqlalchemy.engines [None req-6b422dbd-838c-49ca-8c61-eb9f4c1b6564 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:16:41.007959 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG oslo_db.sqlalchemy.engines [None req-6b422dbd-838c-49ca-8c61-eb9f4c1b6564 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:16:41.009502 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG dbcounter [-] [104125] Writer thread running {{(pid=104125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:16:41.013652 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG dbcounter [-] [104124] Writer thread running {{(pid=104124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:16:41.014800 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG dbcounter [-] [104125] Writer thread running {{(pid=104125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:16:41.015882 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG dbcounter [-] [104124] Writer thread running {{(pid=104124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:16:41.157071 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO dbcounter [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] Registered counter for database nova_cell0 Oct 24 13:16:41.159237 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO dbcounter [None req-6b422dbd-838c-49ca-8c61-eb9f4c1b6564 None None] Registered counter for database nova_cell0 Oct 24 13:16:41.165975 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_db.sqlalchemy.engines [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:16:41.169501 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG oslo_db.sqlalchemy.engines [None req-6b422dbd-838c-49ca-8c61-eb9f4c1b6564 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:16:41.170652 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG dbcounter [-] [104125] Writer thread running {{(pid=104125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:16:41.174254 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG dbcounter [-] [104124] Writer thread running {{(pid=104124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:16:41.577129 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: WARNING keystonemiddleware.auth_token [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:16:41.584504 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: WARNING keystonemiddleware.auth_token [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:16:41.613162 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: WARNING keystonemiddleware.auth_token [None req-6b422dbd-838c-49ca-8c61-eb9f4c1b6564 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:16:41.620855 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: WARNING keystonemiddleware.auth_token [None req-6b422dbd-838c-49ca-8c61-eb9f4c1b6564 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:16:41.923900 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: WARNING keystonemiddleware.auth_token [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:16:41.930404 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: WARNING keystonemiddleware.auth_token [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:16:41.935702 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5569c97be9c0 pid: 104125 (default app) Oct 24 13:16:41.937780 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:41.938965 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001701 Oct 24 13:16:41.939379 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Mon Oct 24 13:16:41 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:16:41.959206 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: WARNING keystonemiddleware.auth_token [None req-6b422dbd-838c-49ca-8c61-eb9f4c1b6564 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:16:41.965446 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: WARNING keystonemiddleware.auth_token [None req-6b422dbd-838c-49ca-8c61-eb9f4c1b6564 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:16:41.970732 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5569c97be9c0 pid: 104124 (default app) Oct 24 13:18:05.274376 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:05.275390 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 24 13:18:05.275790 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 24 13:18:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:05.287529 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG dbcounter [-] [104124] Writing DB stats nova_api:SELECT=3 {{(pid=104124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:05.289207 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG dbcounter [-] [104124] Writing DB stats nova_cell1:SELECT=3 {{(pid=104124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:05.289919 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG dbcounter [-] [104124] Writing DB stats nova_cell0:SELECT=3 {{(pid=104124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:05.292380 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG dbcounter [-] [104124] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:06.181481 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-440e3fd7-255f-48b0-8b1b-5689a53c6e16 admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:06.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-440e3fd7-255f-48b0-8b1b-5689a53c6e16 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.934624 Oct 24 13:18:06.218442 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Oct 24 13:18:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:08.853881 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:08.854887 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-1655d1d3-8030-4cba-9440-256672600db3 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Oct 24 13:18:08.856360 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 24 13:18:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:09.339579 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-04fb125c-d532-4e45-b409-d9872f683e10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:09.447627 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-04fb125c-d532-4e45-b409-d9872f683e10 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.585485 Oct 24 13:18:09.448226 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Oct 24 13:18:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 13:18:09.462862 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG dbcounter [-] [104125] Writing DB stats nova_api:SELECT=3 {{(pid=104125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:09.463698 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG dbcounter [-] [104125] Writing DB stats nova_cell0:SELECT=3 {{(pid=104125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:09.465900 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG dbcounter [-] [104125] Writing DB stats nova_cell1:SELECT=3 {{(pid=104125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:09.466656 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG dbcounter [-] [104125] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:09.674287 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-51e3d3b1-06f7-412f-906f-c4dc672a737b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:09.795255 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-51e3d3b1-06f7-412f-906f-c4dc672a737b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.338117 Oct 24 13:18:09.795848 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1336 bytes} [Mon Oct 24 13:18:09 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:12.379130 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-04fb125c-d532-4e45-b409-d9872f683e10 admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:12.380346 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-04fb125c-d532-4e45-b409-d9872f683e10 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Oct 24 13:18:12.380852 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 24 13:18:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:13.025878 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-c3186dd2-4c7c-4d4e-81aa-f987819b59fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "id": "d1", "name": "ds512M", "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:13.154057 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-c3186dd2-4c7c-4d4e-81aa-f987819b59fe admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.766366 Oct 24 13:18:13.155041 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Oct 24 13:18:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 13:18:13.168375 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-3b91fbdb-1862-444a-96b7-c23e41ee6bfb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:13.283337 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-3b91fbdb-1862-444a-96b7-c23e41ee6bfb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119065 Oct 24 13:18:13.283985 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1336 bytes} [Mon Oct 24 13:18:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:15.875566 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-c3186dd2-4c7c-4d4e-81aa-f987819b59fe admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:15.876571 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-c3186dd2-4c7c-4d4e-81aa-f987819b59fe admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 24 13:18:15.877008 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 24 13:18:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:16.296080 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-d52abeb2-8ece-4365-9d96-ce9dd7de5f20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "name": "ds1G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10}} {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:16.382161 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-d52abeb2-8ece-4365-9d96-ce9dd7de5f20 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.498276 Oct 24 13:18:16.382716 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Oct 24 13:18:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:18:16.396066 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-37673249-598f-4823-aa0a-20efd0b18d42 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:16.477125 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-37673249-598f-4823-aa0a-20efd0b18d42 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085995 Oct 24 13:18:16.477707 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1336 bytes} [Mon Oct 24 13:18:16 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:18:19.083776 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-d52abeb2-8ece-4365-9d96-ce9dd7de5f20 admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:19.085955 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-d52abeb2-8ece-4365-9d96-ce9dd7de5f20 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002609 Oct 24 13:18:19.087357 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 24 13:18:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:19.500998 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-847d89d3-0169-4295-8ff4-a05b02cde9b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "swap": 0, "vcpus": 2, "disk": 10}} {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:19.570696 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-847d89d3-0169-4295-8ff4-a05b02cde9b1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.477480 Oct 24 13:18:19.571602 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Oct 24 13:18:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:18:19.583912 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-67b80cea-7096-4f79-afc9-eb5ef04a2950 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:19.660765 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-67b80cea-7096-4f79-afc9-eb5ef04a2950 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080547 Oct 24 13:18:19.661457 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1336 bytes} [Mon Oct 24 13:18:19 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:22.297349 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-847d89d3-0169-4295-8ff4-a05b02cde9b1 admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:22.298337 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-847d89d3-0169-4295-8ff4-a05b02cde9b1 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Oct 24 13:18:22.298792 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 24 13:18:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:22.717416 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-ad8f2f9f-748f-49fb-b14c-b5f133193e99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:22.793000 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-ad8f2f9f-748f-49fb-b14c-b5f133193e99 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.487276 Oct 24 13:18:22.793464 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Oct 24 13:18:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 13:18:22.806003 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-90d3b6a2-d52a-4f5e-b2dd-573d3629ab90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:22.882529 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-90d3b6a2-d52a-4f5e-b2dd-573d3629ab90 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080545 Oct 24 13:18:22.883047 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1336 bytes} [Mon Oct 24 13:18:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:25.910100 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-ad8f2f9f-748f-49fb-b14c-b5f133193e99 admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:25.911470 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-ad8f2f9f-748f-49fb-b14c-b5f133193e99 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001980 Oct 24 13:18:25.911937 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 24 13:18:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:26.322365 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-326212eb-ab52-48d2-9b15-4b597ccc6089 admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:26.347744 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-326212eb-ab52-48d2-9b15-4b597ccc6089 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.428900 Oct 24 13:18:26.348695 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Oct 24 13:18:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:28.940649 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-ad8f2f9f-748f-49fb-b14c-b5f133193e99 admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:28.941671 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-ad8f2f9f-748f-49fb-b14c-b5f133193e99 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Oct 24 13:18:28.942085 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 24 13:18:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:29.334013 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-1a43fd20-6759-4a32-ad27-91ac5089de89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:29.392875 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-1a43fd20-6759-4a32-ad27-91ac5089de89 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.444005 Oct 24 13:18:29.393547 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Oct 24 13:18:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:18:29.406536 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-4b25944e-8f06-4f88-95a5-36250ff5a497 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:29.482496 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-4b25944e-8f06-4f88-95a5-36250ff5a497 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080026 Oct 24 13:18:29.483001 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1333 bytes} [Mon Oct 24 13:18:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:18:32.073257 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-1a43fd20-6759-4a32-ad27-91ac5089de89 admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:32.074282 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-1a43fd20-6759-4a32-ad27-91ac5089de89 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 24 13:18:32.074688 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 24 13:18:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:32.480559 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-5e3a98ee-c91e-4a38-bbec-003b39f0975c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:32.609465 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-5e3a98ee-c91e-4a38-bbec-003b39f0975c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.527616 Oct 24 13:18:32.610013 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Oct 24 13:18:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:18:32.622088 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-5735ee01-69ed-4a94-a661-ddbfaeb2e9b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:32.704889 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-5735ee01-69ed-4a94-a661-ddbfaeb2e9b0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086424 Oct 24 13:18:32.705455 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1333 bytes} [Mon Oct 24 13:18:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:18:35.328622 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-5e3a98ee-c91e-4a38-bbec-003b39f0975c admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:35.330297 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-5e3a98ee-c91e-4a38-bbec-003b39f0975c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002165 Oct 24 13:18:35.330690 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 24 13:18:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:35.772999 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-08e0b4bf-e15f-4bf4-9f85-e2249ec46ff8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "ram": 4096, "disk": 40, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:35.855515 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-08e0b4bf-e15f-4bf4-9f85-e2249ec46ff8 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.518796 Oct 24 13:18:35.857281 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Oct 24 13:18:35 2022] POST /compute/v2.1/flavors => generated 406 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:18:35.868653 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-48911133-2614-4cb7-b987-3eba58a3a8b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:35.874209 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG dbcounter [-] [104124] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:35.964408 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-48911133-2614-4cb7-b987-3eba58a3a8b1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099319 Oct 24 13:18:35.965238 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1333 bytes} [Mon Oct 24 13:18:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:38.593570 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-08e0b4bf-e15f-4bf4-9f85-e2249ec46ff8 admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:38.595476 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-08e0b4bf-e15f-4bf4-9f85-e2249ec46ff8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002323 Oct 24 13:18:38.601834 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 24 13:18:38 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:39.110769 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-0a6887cc-ed1e-4838-bd87-95e7f957167a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 80, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "vcpus": 4, "id": "4"}} {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:39.216350 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-0a6887cc-ed1e-4838-bd87-95e7f957167a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.612846 Oct 24 13:18:39.216871 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Oct 24 13:18:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:18:39.229581 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-8f54cd96-ceb3-47ca-8e9a-1b03b315a40e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:39.317732 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-8f54cd96-ceb3-47ca-8e9a-1b03b315a40e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092544 Oct 24 13:18:39.319275 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1333 bytes} [Mon Oct 24 13:18:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:18:41.917096 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-0a6887cc-ed1e-4838-bd87-95e7f957167a admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:41.918116 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-0a6887cc-ed1e-4838-bd87-95e7f957167a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Oct 24 13:18:41.918512 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 24 13:18:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:42.352444 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-8c29f6e2-8bec-4908-a116-2bfcab0ec95c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 160, "vcpus": 8, "id": "5", "ram": 16384}} {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:42.417008 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG dbcounter [-] [104125] Writing DB stats nova_api:SELECT=46,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:42.424532 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-8c29f6e2-8bec-4908-a116-2bfcab0ec95c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.499770 Oct 24 13:18:42.425025 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Oct 24 13:18:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:18:42.439499 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-c036ff23-c69c-41a5-b466-29c981af529b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:42.512061 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-c036ff23-c69c-41a5-b466-29c981af529b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078087 Oct 24 13:18:42.512906 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1333 bytes} [Mon Oct 24 13:18:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:59.778384 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-8c29f6e2-8bec-4908-a116-2bfcab0ec95c admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:59.779359 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-8c29f6e2-8bec-4908-a116-2bfcab0ec95c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Oct 24 13:18:59.779759 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 24 13:18:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:59.790794 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG dbcounter [-] [104124] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:00.169058 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-406773e5-1ad9-4938-a4ef-6f063a21719a admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:00.186569 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-406773e5-1ad9-4938-a4ef-6f063a21719a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400507 Oct 24 13:19:00.187099 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Oct 24 13:18:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:19:01.478010 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-8c29f6e2-8bec-4908-a116-2bfcab0ec95c admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:01.479009 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-8c29f6e2-8bec-4908-a116-2bfcab0ec95c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Oct 24 13:19:01.479420 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 24 13:19:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:01.996556 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-ed51ce6d-3f24-4878-a0c7-c49ed630b562 admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:02.001858 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.wsgi [None req-ed51ce6d-3f24-4878-a0c7-c49ed630b562 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-ed51ce6d-3f24-4878-a0c7-c49ed630b562 admin admin] Request method failure captured: Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Accept: application/json Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Accept-Encoding: gzip, deflate Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Connection: keep-alive Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Content-Length: 0 Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Host: 10.222.0.48 Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Openstack-Api-Version: compute 2.92 Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Openstack-System-Scope: None Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: User-Agent: python-novaclient Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Auth-Token: gAAAAABjVpDFXcTpiOjDlCOuE_uDYWU3ELZ6h3PFXMTAAPBDTlyyiyzgQFAgM4RK-B6wwRWtG76Y66qQwDK1BuOm7j4QixVGI1spCSlO7TmmRQKTyLzDQRdoaRcfB1AzsE-Q4090s9cwUxsw_Tc_4iMFrlGaXEP6RnxdOFFnudWXTAohPrtX-G0 Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Domain-Id: None Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Domain-Name: None Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Identity-Status: Confirmed Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Is-Admin-Project: True Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Project-Domain-Id: default Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Project-Domain-Name: Default Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Project-Id: c5f7bf50f5a94c7694720e6be18c9de2 Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Project-Name: admin Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Role: reader,member,admin Oct 24 13:19:02.005062 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Roles: reader,member,admin Oct 24 13:19:02.007299 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c5f7bf50f5a94c7694720e6be18c9de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5f7bf50f5a94c7694720e6be18c9de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5f7bf50f5a94c7694720e6be18c9de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c5f7bf50f5a94c7694720e6be18c9de2"}]}] Oct 24 13:19:02.007299 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Tenant: admin Oct 24 13:19:02.007299 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Tenant-Id: c5f7bf50f5a94c7694720e6be18c9de2 Oct 24 13:19:02.007299 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Tenant-Name: admin Oct 24 13:19:02.007299 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-User: admin Oct 24 13:19:02.007299 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-User-Domain-Id: default Oct 24 13:19:02.007299 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-User-Domain-Name: Default Oct 24 13:19:02.007299 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-User-Id: 742bb1241cf54598b570a2fd87179834 Oct 24 13:19:02.007299 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-User-Name: admin Oct 24 13:19:02.007299 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: method: > Oct 24 13:19:02.007299 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: exception: Flavor 42 could not be found. Oct 24 13:19:02.007299 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: action_args: {'id': '42'} Oct 24 13:19:02.007299 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:02.007299 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:02.009308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 13:19:02.009308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 13:19:02.009308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 13:19:02.009308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 13:19:02.009308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:19:02.009308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:19:02.009308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 13:19:02.009308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 13:19:02.009308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 13:19:02.009308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:02.009308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 13:19:02.009308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 13:19:02.009308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 24 13:19:02.009308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Oct 24 13:19:02.009308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:02.009308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Oct 24 13:19:02.009308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:02.009308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:02.009308 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:02.010747 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:02.010747 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:02.010747 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:02.010747 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:02.010747 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 13:19:02.010747 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:02.010747 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 24 13:19:02.010747 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Oct 24 13:19:02.010747 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:02.010747 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Oct 24 13:19:02.010747 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:02.010747 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:02.010747 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:02.010747 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:02.010747 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:02.010747 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 24 13:19:02.010747 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Oct 24 13:19:02.010747 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-ed51ce6d-3f24-4878-a0c7-c49ed630b562 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:02.012163 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-ed51ce6d-3f24-4878-a0c7-c49ed630b562 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.389205 Oct 24 13:19:02.012163 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Oct 24 13:19:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:02.016825 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-b9706425-4166-4953-b441-142a5e589346 admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:02.039490 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-b9706425-4166-4953-b441-142a5e589346 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026153 Oct 24 13:19:02.039953 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Oct 24 13:19:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:19:02.050463 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-8ab78bb3-f778-4652-b684-ff6e19d19d1f admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:02.072389 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-8ab78bb3-f778-4652-b684-ff6e19d19d1f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026402 Oct 24 13:19:02.072915 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Oct 24 13:19:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:19:02.082236 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-bc200e87-fcc0-4e74-b056-67cb1bb6a15c admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:02.089137 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.wsgi [None req-bc200e87-fcc0-4e74-b056-67cb1bb6a15c admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-bc200e87-fcc0-4e74-b056-67cb1bb6a15c admin admin] Request method failure captured: Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Accept: application/json Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Accept-Encoding: gzip, deflate Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Connection: keep-alive Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Content-Length: 0 Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Host: 10.222.0.48 Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Openstack-Api-Version: compute 2.92 Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Openstack-System-Scope: None Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: User-Agent: python-novaclient Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Auth-Token: gAAAAABjVpDFXcTpiOjDlCOuE_uDYWU3ELZ6h3PFXMTAAPBDTlyyiyzgQFAgM4RK-B6wwRWtG76Y66qQwDK1BuOm7j4QixVGI1spCSlO7TmmRQKTyLzDQRdoaRcfB1AzsE-Q4090s9cwUxsw_Tc_4iMFrlGaXEP6RnxdOFFnudWXTAohPrtX-G0 Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Domain-Id: None Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Domain-Name: None Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Identity-Status: Confirmed Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Is-Admin-Project: True Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Project-Domain-Id: default Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Project-Domain-Name: Default Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Project-Id: c5f7bf50f5a94c7694720e6be18c9de2 Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Project-Name: admin Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Role: reader,member,admin Oct 24 13:19:02.092527 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Roles: reader,member,admin Oct 24 13:19:02.094121 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c5f7bf50f5a94c7694720e6be18c9de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5f7bf50f5a94c7694720e6be18c9de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5f7bf50f5a94c7694720e6be18c9de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c5f7bf50f5a94c7694720e6be18c9de2"}]}] Oct 24 13:19:02.094121 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Tenant: admin Oct 24 13:19:02.094121 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Tenant-Id: c5f7bf50f5a94c7694720e6be18c9de2 Oct 24 13:19:02.094121 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Tenant-Name: admin Oct 24 13:19:02.094121 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-User: admin Oct 24 13:19:02.094121 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-User-Domain-Id: default Oct 24 13:19:02.094121 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-User-Domain-Name: Default Oct 24 13:19:02.094121 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-User-Id: 742bb1241cf54598b570a2fd87179834 Oct 24 13:19:02.094121 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-User-Name: admin Oct 24 13:19:02.094121 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: method: > Oct 24 13:19:02.094121 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: exception: Flavor 42 could not be found. Oct 24 13:19:02.094121 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: action_args: {'id': '42'} Oct 24 13:19:02.094121 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:02.094121 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:02.095069 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 13:19:02.095069 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 13:19:02.095069 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 13:19:02.095069 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 13:19:02.095069 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:19:02.095069 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:19:02.095069 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 13:19:02.095069 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 13:19:02.095069 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 13:19:02.095069 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:02.095069 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 13:19:02.095069 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 13:19:02.095069 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 24 13:19:02.095069 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Oct 24 13:19:02.095069 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:02.095069 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Oct 24 13:19:02.095069 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:02.095069 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:02.095069 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:02.096329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:02.096329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:02.096329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:02.096329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:02.096329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 13:19:02.096329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:02.096329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 24 13:19:02.096329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Oct 24 13:19:02.096329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:02.096329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Oct 24 13:19:02.096329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:02.096329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:02.096329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:02.096329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:02.096329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:02.096329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 24 13:19:02.096329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Oct 24 13:19:02.096329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-bc200e87-fcc0-4e74-b056-67cb1bb6a15c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:02.098008 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-bc200e87-fcc0-4e74-b056-67cb1bb6a15c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015261 Oct 24 13:19:02.098008 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Oct 24 13:19:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:03.283316 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-8ab78bb3-f778-4652-b684-ff6e19d19d1f admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:03.284355 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-8ab78bb3-f778-4652-b684-ff6e19d19d1f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Oct 24 13:19:03.284777 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 24 13:19:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:03.801955 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-7eabddfb-c01b-4d9a-91bc-2f481da3d312 admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:03.806920 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.wsgi [None req-7eabddfb-c01b-4d9a-91bc-2f481da3d312 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-7eabddfb-c01b-4d9a-91bc-2f481da3d312 admin admin] Request method failure captured: Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Accept: application/json Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Accept-Encoding: gzip, deflate Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Connection: keep-alive Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Content-Length: 0 Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Host: 10.222.0.48 Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Openstack-Api-Version: compute 2.92 Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Openstack-System-Scope: None Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: User-Agent: python-novaclient Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Auth-Token: gAAAAABjVpDHRYbHmYNJJxtTduWmVZPhOvpr8-SugjryCqfCtrNrziGkL_cWQ45ZKcnpggwklZkrqzpDVZXXeObCJThsObyZMrJS2IP3DDK1B6ALgMQoR-IsxGTBeX0GCXuE3jgNgtAQQVwp6FTRDApELZtORsO0alftxT-_1XvWSAOadobYXDI Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Domain-Id: None Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Domain-Name: None Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Identity-Status: Confirmed Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Is-Admin-Project: True Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Project-Domain-Id: default Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Project-Domain-Name: Default Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Project-Id: c5f7bf50f5a94c7694720e6be18c9de2 Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Project-Name: admin Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Role: reader,member,admin Oct 24 13:19:03.808464 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Roles: reader,member,admin Oct 24 13:19:03.810003 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c5f7bf50f5a94c7694720e6be18c9de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5f7bf50f5a94c7694720e6be18c9de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5f7bf50f5a94c7694720e6be18c9de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c5f7bf50f5a94c7694720e6be18c9de2"}]}] Oct 24 13:19:03.810003 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Tenant: admin Oct 24 13:19:03.810003 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Tenant-Id: c5f7bf50f5a94c7694720e6be18c9de2 Oct 24 13:19:03.810003 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Tenant-Name: admin Oct 24 13:19:03.810003 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-User: admin Oct 24 13:19:03.810003 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-User-Domain-Id: default Oct 24 13:19:03.810003 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-User-Domain-Name: Default Oct 24 13:19:03.810003 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-User-Id: 742bb1241cf54598b570a2fd87179834 Oct 24 13:19:03.810003 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-User-Name: admin Oct 24 13:19:03.810003 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: method: > Oct 24 13:19:03.810003 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: exception: Flavor 84 could not be found. Oct 24 13:19:03.810003 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: action_args: {'id': '84'} Oct 24 13:19:03.810003 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:03.810003 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:03.810948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 13:19:03.810948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 13:19:03.810948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 13:19:03.810948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 13:19:03.810948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:19:03.810948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:19:03.810948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 13:19:03.810948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 13:19:03.810948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 13:19:03.810948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:03.810948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 13:19:03.810948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 13:19:03.810948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 24 13:19:03.810948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Oct 24 13:19:03.810948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:03.810948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Oct 24 13:19:03.810948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:03.810948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:03.810948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:03.812342 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:03.812342 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:03.812342 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:03.812342 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:03.812342 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 13:19:03.812342 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:03.812342 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 24 13:19:03.812342 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Oct 24 13:19:03.812342 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:03.812342 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Oct 24 13:19:03.812342 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:03.812342 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:03.812342 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:03.812342 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:03.812342 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:03.812342 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 24 13:19:03.812342 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Oct 24 13:19:03.812342 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-7eabddfb-c01b-4d9a-91bc-2f481da3d312 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:03.813623 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-7eabddfb-c01b-4d9a-91bc-2f481da3d312 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.389422 Oct 24 13:19:03.813623 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Oct 24 13:19:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:03.819893 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-9bf5c686-9b33-4514-8ad7-a5ab0719acef admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:03.835207 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-9bf5c686-9b33-4514-8ad7-a5ab0719acef admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018740 Oct 24 13:19:03.835658 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Oct 24 13:19:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:19:03.845033 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-cf1d3760-f597-4bfe-80e5-8d5dfe87b18c admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:03.860345 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-cf1d3760-f597-4bfe-80e5-8d5dfe87b18c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018714 Oct 24 13:19:03.860859 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Oct 24 13:19:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:19:03.870124 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-3162d425-57b5-48cd-85e3-11f0cfe1ff5a admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:03.875007 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.wsgi [None req-3162d425-57b5-48cd-85e3-11f0cfe1ff5a admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-3162d425-57b5-48cd-85e3-11f0cfe1ff5a admin admin] Request method failure captured: Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Accept: application/json Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Accept-Encoding: gzip, deflate Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Connection: keep-alive Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Content-Length: 0 Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Host: 10.222.0.48 Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Openstack-Api-Version: compute 2.92 Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Openstack-System-Scope: None Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: User-Agent: python-novaclient Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Auth-Token: gAAAAABjVpDHRYbHmYNJJxtTduWmVZPhOvpr8-SugjryCqfCtrNrziGkL_cWQ45ZKcnpggwklZkrqzpDVZXXeObCJThsObyZMrJS2IP3DDK1B6ALgMQoR-IsxGTBeX0GCXuE3jgNgtAQQVwp6FTRDApELZtORsO0alftxT-_1XvWSAOadobYXDI Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Domain-Id: None Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Domain-Name: None Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Identity-Status: Confirmed Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Is-Admin-Project: True Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Project-Domain-Id: default Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Project-Domain-Name: Default Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Project-Id: c5f7bf50f5a94c7694720e6be18c9de2 Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Project-Name: admin Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Role: reader,member,admin Oct 24 13:19:03.876533 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Roles: reader,member,admin Oct 24 13:19:03.878025 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c5f7bf50f5a94c7694720e6be18c9de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5f7bf50f5a94c7694720e6be18c9de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5f7bf50f5a94c7694720e6be18c9de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c5f7bf50f5a94c7694720e6be18c9de2"}]}] Oct 24 13:19:03.878025 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Tenant: admin Oct 24 13:19:03.878025 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Tenant-Id: c5f7bf50f5a94c7694720e6be18c9de2 Oct 24 13:19:03.878025 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Tenant-Name: admin Oct 24 13:19:03.878025 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-User: admin Oct 24 13:19:03.878025 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-User-Domain-Id: default Oct 24 13:19:03.878025 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-User-Domain-Name: Default Oct 24 13:19:03.878025 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-User-Id: 742bb1241cf54598b570a2fd87179834 Oct 24 13:19:03.878025 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-User-Name: admin Oct 24 13:19:03.878025 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: method: > Oct 24 13:19:03.878025 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: exception: Flavor 84 could not be found. Oct 24 13:19:03.878025 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: action_args: {'id': '84'} Oct 24 13:19:03.878025 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:03.878025 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:03.879096 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 13:19:03.879096 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 13:19:03.879096 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 13:19:03.879096 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 13:19:03.879096 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:19:03.879096 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:19:03.879096 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 13:19:03.879096 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 13:19:03.879096 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 13:19:03.879096 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:03.879096 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 13:19:03.879096 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 13:19:03.879096 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 24 13:19:03.879096 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Oct 24 13:19:03.879096 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:03.879096 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Oct 24 13:19:03.879096 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:03.879096 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:03.879096 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:03.880500 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:03.880500 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:03.880500 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:03.880500 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:03.880500 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 13:19:03.880500 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:03.880500 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 24 13:19:03.880500 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Oct 24 13:19:03.880500 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:03.880500 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Oct 24 13:19:03.880500 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:03.880500 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:03.880500 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:03.880500 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:03.880500 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:03.880500 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 24 13:19:03.880500 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Oct 24 13:19:03.880500 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-3162d425-57b5-48cd-85e3-11f0cfe1ff5a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:03.882291 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-3162d425-57b5-48cd-85e3-11f0cfe1ff5a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011155 Oct 24 13:19:03.882291 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Oct 24 13:19:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:05.086061 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-cf1d3760-f597-4bfe-80e5-8d5dfe87b18c admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:05.087085 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-cf1d3760-f597-4bfe-80e5-8d5dfe87b18c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 24 13:19:05.087470 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 24 13:19:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:05.613219 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-408a3968-a25a-4d1d-986d-104eb5de71d9 admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:05.619626 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.wsgi [None req-408a3968-a25a-4d1d-986d-104eb5de71d9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-408a3968-a25a-4d1d-986d-104eb5de71d9 admin admin] Request method failure captured: Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Accept: application/json Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Accept-Encoding: gzip, deflate Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Connection: keep-alive Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Content-Length: 0 Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Host: 10.222.0.48 Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Openstack-Api-Version: compute 2.92 Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Openstack-System-Scope: None Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: User-Agent: python-novaclient Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Auth-Token: gAAAAABjVpDIS2saPyedKJ8aSltBT0JqGtdKltb_nnUE7FW82ibk9iCXF6xbKxzU-bCm1iXMip3SSZlm7EG1YxFtt_PqLd02JY3JvCaUdQHzz2HxIGf4Cl-UmdingeX-o0mHtizz-f3m_PLKaOVz57VEM2IcoPZ2cbyRgXZjOZ72G0FmcViEsy4 Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Domain-Id: None Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Domain-Name: None Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Identity-Status: Confirmed Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Is-Admin-Project: True Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Project-Domain-Id: default Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Project-Domain-Name: Default Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Project-Id: c5f7bf50f5a94c7694720e6be18c9de2 Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Project-Name: admin Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Role: reader,member,admin Oct 24 13:19:05.621154 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Roles: reader,member,admin Oct 24 13:19:05.622780 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c5f7bf50f5a94c7694720e6be18c9de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5f7bf50f5a94c7694720e6be18c9de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5f7bf50f5a94c7694720e6be18c9de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c5f7bf50f5a94c7694720e6be18c9de2"}]}] Oct 24 13:19:05.622780 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Tenant: admin Oct 24 13:19:05.622780 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Tenant-Id: c5f7bf50f5a94c7694720e6be18c9de2 Oct 24 13:19:05.622780 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-Tenant-Name: admin Oct 24 13:19:05.622780 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-User: admin Oct 24 13:19:05.622780 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-User-Domain-Id: default Oct 24 13:19:05.622780 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-User-Domain-Name: Default Oct 24 13:19:05.622780 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-User-Id: 742bb1241cf54598b570a2fd87179834 Oct 24 13:19:05.622780 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: X-User-Name: admin Oct 24 13:19:05.622780 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: method: > Oct 24 13:19:05.622780 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: exception: Flavor 451 could not be found. Oct 24 13:19:05.622780 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: action_args: {'id': '451'} Oct 24 13:19:05.622780 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:05.622780 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:05.623824 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 13:19:05.623824 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 13:19:05.623824 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 13:19:05.623824 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 13:19:05.623824 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:19:05.623824 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:19:05.623824 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 13:19:05.623824 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 13:19:05.623824 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 13:19:05.623824 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:05.623824 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 13:19:05.623824 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 13:19:05.623824 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 24 13:19:05.623824 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Oct 24 13:19:05.623824 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:05.623824 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Oct 24 13:19:05.623824 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:05.623824 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:05.623824 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:05.625422 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:05.625422 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:05.625422 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:05.625422 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:05.625422 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 13:19:05.625422 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:05.625422 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 24 13:19:05.625422 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Oct 24 13:19:05.625422 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:05.625422 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Oct 24 13:19:05.625422 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:05.625422 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:05.625422 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:05.625422 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:05.625422 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:05.625422 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 24 13:19:05.625422 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: ERROR nova.api.openstack.wsgi Oct 24 13:19:05.625422 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-408a3968-a25a-4d1d-986d-104eb5de71d9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:05.626711 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-408a3968-a25a-4d1d-986d-104eb5de71d9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.398337 Oct 24 13:19:05.626711 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Oct 24 13:19:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:05.632941 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-3f72444a-a315-456c-b2bd-8e297b0fc1a7 admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:05.647725 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-3f72444a-a315-456c-b2bd-8e297b0fc1a7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018956 Oct 24 13:19:05.648261 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Oct 24 13:19:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:19:05.657830 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-fb6924f9-495a-4f5a-b7ea-6c24335e3852 admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:05.673085 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-fb6924f9-495a-4f5a-b7ea-6c24335e3852 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018842 Oct 24 13:19:05.673654 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Oct 24 13:19:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:19:05.683659 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-269d08a7-0aff-4db2-a047-f36c0f262da4 admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:05.688728 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.wsgi [None req-269d08a7-0aff-4db2-a047-f36c0f262da4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-269d08a7-0aff-4db2-a047-f36c0f262da4 admin admin] Request method failure captured: Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Accept: application/json Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Accept-Encoding: gzip, deflate Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Connection: keep-alive Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Content-Length: 0 Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Host: 10.222.0.48 Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Openstack-Api-Version: compute 2.92 Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Openstack-System-Scope: None Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: User-Agent: python-novaclient Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Auth-Token: gAAAAABjVpDIS2saPyedKJ8aSltBT0JqGtdKltb_nnUE7FW82ibk9iCXF6xbKxzU-bCm1iXMip3SSZlm7EG1YxFtt_PqLd02JY3JvCaUdQHzz2HxIGf4Cl-UmdingeX-o0mHtizz-f3m_PLKaOVz57VEM2IcoPZ2cbyRgXZjOZ72G0FmcViEsy4 Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Domain-Id: None Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Domain-Name: None Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Identity-Status: Confirmed Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Is-Admin-Project: True Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Project-Domain-Id: default Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Project-Domain-Name: Default Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Project-Id: c5f7bf50f5a94c7694720e6be18c9de2 Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Project-Name: admin Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Role: reader,member,admin Oct 24 13:19:05.690258 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Roles: reader,member,admin Oct 24 13:19:05.691841 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c5f7bf50f5a94c7694720e6be18c9de2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5f7bf50f5a94c7694720e6be18c9de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5f7bf50f5a94c7694720e6be18c9de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c5f7bf50f5a94c7694720e6be18c9de2"}]}] Oct 24 13:19:05.691841 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Tenant: admin Oct 24 13:19:05.691841 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Tenant-Id: c5f7bf50f5a94c7694720e6be18c9de2 Oct 24 13:19:05.691841 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-Tenant-Name: admin Oct 24 13:19:05.691841 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-User: admin Oct 24 13:19:05.691841 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-User-Domain-Id: default Oct 24 13:19:05.691841 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-User-Domain-Name: Default Oct 24 13:19:05.691841 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-User-Id: 742bb1241cf54598b570a2fd87179834 Oct 24 13:19:05.691841 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: X-User-Name: admin Oct 24 13:19:05.691841 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: method: > Oct 24 13:19:05.691841 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: exception: Flavor 451 could not be found. Oct 24 13:19:05.691841 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: action_args: {'id': '451'} Oct 24 13:19:05.691841 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:05.691841 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:05.692938 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 13:19:05.692938 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 13:19:05.692938 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 13:19:05.692938 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 13:19:05.692938 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:19:05.692938 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:19:05.692938 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 13:19:05.692938 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 13:19:05.692938 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 13:19:05.692938 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:05.692938 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 13:19:05.692938 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 13:19:05.692938 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 24 13:19:05.692938 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Oct 24 13:19:05.692938 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:05.692938 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Oct 24 13:19:05.692938 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:05.692938 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:05.692938 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:05.694587 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:05.694587 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:05.694587 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:05.694587 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:05.694587 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 13:19:05.694587 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:05.694587 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 24 13:19:05.694587 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Oct 24 13:19:05.694587 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:05.694587 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Oct 24 13:19:05.694587 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:05.694587 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:05.694587 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:05.694587 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:05.694587 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:05.694587 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 24 13:19:05.694587 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: ERROR nova.api.openstack.wsgi Oct 24 13:19:05.694587 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-269d08a7-0aff-4db2-a047-f36c0f262da4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:05.695596 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-269d08a7-0aff-4db2-a047-f36c0f262da4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011549 Oct 24 13:19:05.695596 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Oct 24 13:19:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 13:19:06.901507 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-fb6924f9-495a-4f5a-b7ea-6c24335e3852 admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:06.902519 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-fb6924f9-495a-4f5a-b7ea-6c24335e3852 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Oct 24 13:19:06.902916 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 24 13:19:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:07.419241 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-abd3da63-eb5a-4503-b593-92833d409d34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:19:07.483978 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-abd3da63-eb5a-4503-b593-92833d409d34 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.442667 Oct 24 13:19:07.484561 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Oct 24 13:19:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:19:08.681971 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-fb6924f9-495a-4f5a-b7ea-6c24335e3852 admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:08.682987 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-fb6924f9-495a-4f5a-b7ea-6c24335e3852 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 24 13:19:08.683413 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 24 13:19:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:19:09.200446 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-c1b2c3e9-fe4e-4997-929c-f5061ab4a4b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:19:09.260948 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-c1b2c3e9-fe4e-4997-929c-f5061ab4a4b0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.439682 Oct 24 13:19:09.261601 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Oct 24 13:19:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:19:10.473221 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-fb6924f9-495a-4f5a-b7ea-6c24335e3852 admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:10.474228 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-fb6924f9-495a-4f5a-b7ea-6c24335e3852 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 24 13:19:10.474621 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 24 13:19:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:10.993425 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-349db54f-168d-4d7b-bc1d-42cc66642fa8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:19:11.055454 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-349db54f-168d-4d7b-bc1d-42cc66642fa8 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.443071 Oct 24 13:19:11.056004 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Oct 24 13:19:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:19:12.247136 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-fb6924f9-495a-4f5a-b7ea-6c24335e3852 admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:12.248120 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-fb6924f9-495a-4f5a-b7ea-6c24335e3852 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Oct 24 13:19:12.248550 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 24 13:19:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:12.761296 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-c0159ce5-41c9-4ae4-83a9-75a87ccc44fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:19:12.838012 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-c0159ce5-41c9-4ae4-83a9-75a87ccc44fc admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.454410 Oct 24 13:19:12.838819 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Oct 24 13:19:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:19:14.044149 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-fb6924f9-495a-4f5a-b7ea-6c24335e3852 admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:14.045176 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-fb6924f9-495a-4f5a-b7ea-6c24335e3852 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 24 13:19:14.045573 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 24 13:19:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:14.558900 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-03abd7d0-6496-4f3e-bbb7-2406cf9c9a1e admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:14.579347 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-03abd7d0-6496-4f3e-bbb7-2406cf9c9a1e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.397402 Oct 24 13:19:14.579876 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Mon Oct 24 13:19:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:20:10.795233 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-fb6924f9-495a-4f5a-b7ea-6c24335e3852 admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:20:10.796242 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-fb6924f9-495a-4f5a-b7ea-6c24335e3852 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 24 13:20:10.796677 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 24 13:20:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:20:10.807707 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG dbcounter [-] [104125] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=4 {{(pid=104125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:11.184827 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-00842823-64db-49d5-b40d-ed5061b0fe90 admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:20:11.204976 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-00842823-64db-49d5-b40d-ed5061b0fe90 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401803 Oct 24 13:20:11.205498 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Oct 24 13:20:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:20:11.227313 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG dbcounter [-] [104124] Writing DB stats nova_api:SELECT=14 {{(pid=104124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:11.231008 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-bc1bb7ac-12f9-4057-84b0-8973f34f00c8 admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:20:11.238083 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-bc1bb7ac-12f9-4057-84b0-8973f34f00c8 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012260 Oct 24 13:20:11.240000 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1283 bytes} [Mon Oct 24 13:20:11 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:20:11.250607 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-99bc19b0-52ec-415e-9b64-60c36b3cde62 admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:20:11.257879 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-99bc19b0-52ec-415e-9b64-60c36b3cde62 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010972 Oct 24 13:20:11.258390 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1286 bytes} [Mon Oct 24 13:20:11 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:20:11.269553 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-d21caf5a-2eb6-4a28-bc74-e40c517dc0bc admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:20:11.276763 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-d21caf5a-2eb6-4a28-bc74-e40c517dc0bc admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010637 Oct 24 13:20:11.277269 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1286 bytes} [Mon Oct 24 13:20:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:20:11.288640 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-522e48e4-f5f7-4baf-a2f0-86b75ae87904 admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:20:11.295568 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-522e48e4-f5f7-4baf-a2f0-86b75ae87904 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010837 Oct 24 13:20:11.296072 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1283 bytes} [Mon Oct 24 13:20:11 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:23:19.551777 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-d21caf5a-2eb6-4a28-bc74-e40c517dc0bc admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:19.552817 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-d21caf5a-2eb6-4a28-bc74-e40c517dc0bc admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Oct 24 13:23:19.553218 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 24 13:23:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:23:19.693158 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG dbcounter [-] [104125] Writing DB stats nova_api:SELECT=6 {{(pid=104125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:19.835087 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-719642ae-e2d9-4912-8ac5-61e39e054be2 admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:19.840419 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-719642ae-e2d9-4912-8ac5-61e39e054be2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:19.840902 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-719642ae-e2d9-4912-8ac5-61e39e054be2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:19.841329 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-719642ae-e2d9-4912-8ac5-61e39e054be2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:19.842044 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-719642ae-e2d9-4912-8ac5-61e39e054be2 admin admin] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:19.842493 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-719642ae-e2d9-4912-8ac5-61e39e054be2 admin admin] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:19.842912 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-719642ae-e2d9-4912-8ac5-61e39e054be2 admin admin] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:19.874168 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-719642ae-e2d9-4912-8ac5-61e39e054be2 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.182275 Oct 24 13:23:19.874712 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Oct 24 13:23:19 2022] GET /compute/v2.1/os-services => generated 791 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:23:20.926585 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-d21caf5a-2eb6-4a28-bc74-e40c517dc0bc admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:20.927591 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-d21caf5a-2eb6-4a28-bc74-e40c517dc0bc admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 24 13:23:20.927992 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 24 13:23:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:23:21.120078 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-3663fda6-2376-4a14-9344-ad5f75c85d03 admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:21.123462 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-3663fda6-2376-4a14-9344-ad5f75c85d03 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:21.123963 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-3663fda6-2376-4a14-9344-ad5f75c85d03 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:21.124423 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-3663fda6-2376-4a14-9344-ad5f75c85d03 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:21.125123 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-3663fda6-2376-4a14-9344-ad5f75c85d03 admin admin] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:21.125562 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-3663fda6-2376-4a14-9344-ad5f75c85d03 admin admin] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:21.125971 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-3663fda6-2376-4a14-9344-ad5f75c85d03 admin admin] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:21.145266 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-3663fda6-2376-4a14-9344-ad5f75c85d03 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077236 Oct 24 13:23:21.145797 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Oct 24 13:23:21 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:23:32.582773 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-d21caf5a-2eb6-4a28-bc74-e40c517dc0bc admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:32.583815 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-d21caf5a-2eb6-4a28-bc74-e40c517dc0bc admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Oct 24 13:23:32.584634 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 24 13:23:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:23:32.726599 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG dbcounter [-] [104125] Writing DB stats nova_cell0:SELECT=4 {{(pid=104125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:32.727262 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG dbcounter [-] [104125] Writing DB stats nova_cell1:SELECT=4 {{(pid=104125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:32.727856 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG dbcounter [-] [104125] Writing DB stats nova_api:SELECT=8 {{(pid=104125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:32.775657 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-91c137da-064a-4d2b-96e4-6deefa1a9447 admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:32.779196 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-91c137da-064a-4d2b-96e4-6deefa1a9447 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:32.779730 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-91c137da-064a-4d2b-96e4-6deefa1a9447 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:32.780161 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-91c137da-064a-4d2b-96e4-6deefa1a9447 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:32.780908 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-91c137da-064a-4d2b-96e4-6deefa1a9447 admin admin] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:32.781359 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-91c137da-064a-4d2b-96e4-6deefa1a9447 admin admin] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:32.781775 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-91c137da-064a-4d2b-96e4-6deefa1a9447 admin admin] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:32.809249 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-91c137da-064a-4d2b-96e4-6deefa1a9447 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.087075 Oct 24 13:23:32.809814 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Oct 24 13:23:32 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:23:33.864139 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG nova.api.openstack.wsgi [None req-d21caf5a-2eb6-4a28-bc74-e40c517dc0bc admin admin] Calling method '>' {{(pid=104124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:33.865183 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: INFO nova.api.openstack.requestlog [None req-d21caf5a-2eb6-4a28-bc74-e40c517dc0bc admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 24 13:23:33.865584 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: [pid: 104124|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 24 13:23:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:23:34.053850 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG nova.api.openstack.wsgi [None req-9c42cf4a-6fe0-4cb9-9b16-c9bb3de4acc0 admin admin] Calling method '>' {{(pid=104125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:34.057772 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-9c42cf4a-6fe0-4cb9-9b16-c9bb3de4acc0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:34.058246 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-9c42cf4a-6fe0-4cb9-9b16-c9bb3de4acc0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:34.058672 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-9c42cf4a-6fe0-4cb9-9b16-c9bb3de4acc0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:34.059379 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-9c42cf4a-6fe0-4cb9-9b16-c9bb3de4acc0 admin admin] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:34.059823 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-9c42cf4a-6fe0-4cb9-9b16-c9bb3de4acc0 admin admin] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:34.060237 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: DEBUG oslo_concurrency.lockutils [None req-9c42cf4a-6fe0-4cb9-9b16-c9bb3de4acc0 admin admin] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:34.081924 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: INFO nova.api.openstack.requestlog [None req-9c42cf4a-6fe0-4cb9-9b16-c9bb3de4acc0 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.078405 Oct 24 13:23:34.082472 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: [pid: 104125|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Oct 24 13:23:34 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:24:30.776607 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: Mon Oct 24 13:24:30 2022 - graceful shutdown triggered... Oct 24 13:24:30.776671 dv-cinder-862491-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 24 13:24:30.777601 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: Gracefully killing worker 1 (pid: 104124)... Oct 24 13:24:30.778364 dv-cinder-862491-1-iscsi devstack@n-api.service[104125]: Gracefully killing worker 2 (pid: 104125)... Oct 24 13:24:30.903465 dv-cinder-862491-1-iscsi devstack@n-api.service[104124]: DEBUG dbcounter [-] [104124] Writing DB stats nova_api:SELECT=4 {{(pid=104124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:24:31.777688 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: worker 1 buried after 1 seconds Oct 24 13:24:31.778248 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: worker 2 buried after 1 seconds Oct 24 13:24:31.778248 dv-cinder-862491-1-iscsi devstack@n-api.service[104123]: goodbye to uWSGI. Oct 24 13:24:31.779202 dv-cinder-862491-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 24 13:24:31.779805 dv-cinder-862491-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 24 13:24:31.782644 dv-cinder-862491-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 24 13:24:31.793092 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 24 13:24:31.795080 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 24 13:24:31 2022] *** Oct 24 13:24:31.795080 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 24 13:24:31.795080 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 24 13:24:31.795080 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: nodename: dv-cinder-862491-1-iscsi Oct 24 13:24:31.795080 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: machine: x86_64 Oct 24 13:24:31.795080 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: clock source: unix Oct 24 13:24:31.795080 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: pcre jit disabled Oct 24 13:24:31.795080 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: detected number of CPU cores: 4 Oct 24 13:24:31.795080 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: current working directory: / Oct 24 13:24:31.795080 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: detected binary path: /usr/bin/uwsgi-core Oct 24 13:24:31.795080 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: your processes number limit is 47680 Oct 24 13:24:31.795966 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: your memory page size is 4096 bytes Oct 24 13:24:31.795966 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: detected max file descriptor number: 2048 Oct 24 13:24:31.795966 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: lock engine: pthread robust mutexes Oct 24 13:24:31.795966 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: thunder lock: enabled Oct 24 13:24:31.795966 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 24 13:24:31.795966 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 24 13:24:31.834988 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: Python main interpreter initialized at 0x55b5a37309c0 Oct 24 13:24:31.834988 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: python threads support enabled Oct 24 13:24:31.834988 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: your server socket listen backlog is limited to 100 connections Oct 24 13:24:31.834988 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: your mercy for graceful operations on workers is 90 seconds Oct 24 13:24:31.835446 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: mapped 403077 bytes (393 KB) for 2 cores Oct 24 13:24:31.835446 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: *** Operational MODE: preforking *** Oct 24 13:24:31.835604 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: *** uWSGI is running in multiple interpreter mode *** Oct 24 13:24:31.835604 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: spawned uWSGI master process (pid: 119123) Oct 24 13:24:31.835814 dv-cinder-862491-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 24 13:24:31.839771 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: spawned uWSGI worker 1 (pid: 119145, cores: 1) Oct 24 13:24:31.846277 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: spawned uWSGI worker 2 (pid: 119146, cores: 1) Oct 24 13:24:31.846277 dv-cinder-862491-1-iscsi devstack@n-api.service[119123]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 24 13:24:32.499917 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 13:24:32.506061 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 13:24:33.741355 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:24:33.741355 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: from cryptography.utils import int_from_bytes Oct 24 13:24:33.741999 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:24:33.741999 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: from cryptography.utils import int_from_bytes Oct 24 13:24:33.751288 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:24:33.751288 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: from cryptography.utils import int_from_bytes Oct 24 13:24:33.751824 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:24:33.751824 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: from cryptography.utils import int_from_bytes Oct 24 13:24:36.159772 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 13:24:36.160498 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 13:24:36.160593 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 13:24:36.160945 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 13:24:36.161197 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 13:24:36.161578 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.161894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.162215 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.162532 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.162858 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.163165 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.163480 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.163794 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.164120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.164403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.164718 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.165038 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862491-1-iscsi {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.165358 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.165662 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.166524 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.166839 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.167142 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.167461 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.167770 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.168312 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.169776 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.169776 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.169776 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.169776 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.170117 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.170320 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.170576 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.170883 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.171208 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.171567 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.171692 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 13:24:36.172090 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 13:24:36.172166 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862491-1-iscsi {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.172248 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.172473 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 13:24:36.172690 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.172913 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 13:24:36.173138 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.173365 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 13:24:36.173586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.173806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.174022 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.174241 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.174459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.174679 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.174887 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.175105 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.175311 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.175521 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.175846 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.176079 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.176321 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.176577 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.176759 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.176987 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.177149 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.177338 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.177509 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.177685 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.177864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.178021 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.178215 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.178396 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862491-1-iscsi {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.178551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.178707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.178863 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.179017 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.179189 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.179343 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.179488 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.179488 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.179791 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.179955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.180108 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.180254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.180452 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.180606 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.180751 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.180921 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.180921 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.181232 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.181440 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.182255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.182491 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.183443 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.183612 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.183761 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.183907 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.184052 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.184223 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.184402 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.184547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.184703 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.184848 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.184998 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.185155 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.185302 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.185455 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.185606 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.185751 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.185895 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.186049 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.186049 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.186401 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862491-1-iscsi {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.186550 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.186695 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.186849 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.186994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.187139 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.187285 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.188857 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.189020 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.189174 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.189327 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.189474 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.189637 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.189789 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.189946 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.190107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.190255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.190410 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.190563 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.190717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.190876 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.191029 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.191180 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.191332 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.191489 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.191648 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.191793 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.191938 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.192082 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.192293 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.192457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.192621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.192775 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.193640 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.193805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.193959 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.194103 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.194269 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.194416 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.194640 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.194807 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.194962 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.195113 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.195268 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.195419 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.195564 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.195717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.195869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.196025 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.196190 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.196369 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.196520 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.196664 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.196811 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.196968 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.197122 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.197267 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.197413 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.197557 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.197711 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.197863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.198026 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.198179 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.198332 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.198476 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.198630 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.198774 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.198920 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.199070 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.199222 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.199373 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.199532 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.199684 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.199830 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.199986 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.200131 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.200131 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.200461 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.200607 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.200751 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.200914 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.201059 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.201204 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.201348 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.201493 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.201643 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.201801 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.201964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.202117 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.202262 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.202446 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.202610 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.202756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.202901 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.203706 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.203871 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.204018 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.204176 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.204354 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.204629 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.204791 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.204936 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.205088 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.205250 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.205395 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.205540 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.205696 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.205842 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.205993 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.205993 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.206282 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.206426 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.206585 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.206585 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.206882 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.207028 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.207180 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.207333 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.207485 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.207485 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.207852 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.208260 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.208442 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.208586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.208729 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.208893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.209048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.209194 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.209347 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.209500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.209652 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.209804 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.209963 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.210108 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.210252 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.210643 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.210802 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.210973 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.211694 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.211797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.211887 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.211963 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.212050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.212135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.212210 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.212317 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.212410 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.212486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.212566 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.212566 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.213251 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.213335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.213415 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.213415 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.213561 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.213561 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.213707 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.213779 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.213862 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.213941 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.214014 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.214014 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.214150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.214222 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.214302 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.214383 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.214455 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.214526 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.214603 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.214603 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.214747 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.214825 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.214903 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.214903 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.215032 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.215116 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.215197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.215270 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.215340 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.215419 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.215500 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.215500 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.215641 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.215712 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.215712 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.215839 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.215909 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.215993 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.216072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.216152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.216234 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.216352 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.216438 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.216525 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.216605 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.216685 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.216757 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.216838 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.216920 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.217000 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.217086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.217171 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.217268 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.217355 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.217453 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.217553 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.217647 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.217733 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.217823 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.217915 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.218001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.218097 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.218190 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.218286 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.218370 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:24:36.218454 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.218545 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.218644 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.218738 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.218831 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.218918 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.219004 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.219094 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.219192 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.219192 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.219355 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.219447 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.219538 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.219633 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.219719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.219810 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.219894 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.219978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.220068 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.220165 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.220258 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.220427 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.220545 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.220658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.220777 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.220904 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.221019 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.221217 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.221379 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.221533 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.221688 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.221847 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.221996 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.222149 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.222303 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.222458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.222615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.222780 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.222935 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.223082 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.223242 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.223393 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.223551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.223706 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.223852 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.224006 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.224153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.224336 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.224505 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.224661 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.224824 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.224970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.225124 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.225270 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.225431 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.225594 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.225824 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.225975 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.226130 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.226295 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.226453 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.226608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.226761 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.226925 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.227073 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.227243 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.227390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.227544 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.227698 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.227851 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.228004 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.228217 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.228464 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.229126 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.229283 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.229431 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.229603 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.229765 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.231235 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.231410 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.231571 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.231721 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.231878 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.232026 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.232217 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.232399 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.232554 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.232701 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.232872 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.233026 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.233173 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.233336 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.233486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.233632 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.233786 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.233938 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.234092 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.234246 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.234393 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.234393 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.234694 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.234865 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.235018 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.235178 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.237423 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.237720 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.237890 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.238097 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.238264 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.238427 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.238583 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.238752 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.238908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.239061 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.239237 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.239400 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.239553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.239716 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.239877 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.240031 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.240183 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.240371 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.240536 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.240700 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.240856 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.241016 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.241177 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.241353 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.241557 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.241716 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.241870 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.242031 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.242184 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.242336 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.242503 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.245098 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.245330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.245495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.245659 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.245826 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.245996 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.246163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.246325 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.246479 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.246639 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.246799 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.246968 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.247133 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.247287 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.247447 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.247609 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.247795 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.247969 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.248132 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.248339 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.248501 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.248662 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.248829 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.248982 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.249136 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.249306 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.249459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.249611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.249775 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.249928 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.250092 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.250245 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.250398 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.250550 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.250715 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.250715 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.251021 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.251183 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.251337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.251337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.251647 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.251800 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.251952 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.252114 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.252303 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.252482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.252636 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.252789 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.252949 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.253101 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.253261 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.253437 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.253596 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.253748 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.253901 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.254071 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.254224 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.254387 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.254547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.254700 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.254852 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.255004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.255163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.255329 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.255483 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.255636 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.255636 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.255636 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.256096 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.256249 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.256444 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.256608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.256769 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.256929 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.257090 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.257243 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.257403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.257564 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.257727 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.257888 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.258054 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.261356 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.262939 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.263992 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.264157 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.264385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.264547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.264701 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.264863 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.265017 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.265180 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.265352 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.265505 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.265664 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.265817 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.265970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.266132 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.266293 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.266454 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.266627 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.266789 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.266789 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.267101 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.267256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.267428 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.267589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.267742 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.267901 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.268068 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.268229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.268405 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.268570 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.268731 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.268965 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.269130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.269292 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.269445 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.269609 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.269761 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.269923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.270085 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.270247 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.270408 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.270561 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.270713 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.270879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.271032 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.271187 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.271348 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.271509 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.271679 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.271679 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.271993 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.272154 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.272413 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.272573 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.272740 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.272902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.273054 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.273206 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.273359 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.273518 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.273684 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.273857 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.274018 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.274171 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.274324 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.274485 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.274649 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.277444 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.277630 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.277800 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.277966 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.278130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.278304 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.278467 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.278632 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.278788 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.278986 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.279143 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.279348 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.279503 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.279698 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.279853 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.280018 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.280224 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.280451 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.280631 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.280796 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.280957 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.281118 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.281272 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.281425 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.281586 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.281750 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.281904 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.282057 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.282209 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.282370 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.282543 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.282698 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.282859 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.283014 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.283175 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.283336 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.283501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.283662 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.283817 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.283817 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.284125 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.284314 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.284486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.284651 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.284651 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.284959 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.285113 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.285113 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.285412 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.285565 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.285726 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.285882 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.286049 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.286222 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.286390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.286544 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.286764 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.286934 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.287097 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.287260 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.287421 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.287576 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.287738 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.287892 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.288054 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.288208 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.288386 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.288386 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.288695 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.288860 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.289015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.289177 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.289331 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.289485 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.289653 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.289852 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.290019 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.290183 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.290336 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.290489 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.290652 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.290824 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.291572 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.291743 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.291902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.292127 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.296375 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.296497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.296658 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.296754 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.296850 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.296947 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.297034 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.297127 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.297221 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.297302 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.297388 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.297486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.297573 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.297658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.297749 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.297835 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.297920 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.298013 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.298098 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.298183 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.298267 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.298267 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.298267 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.298556 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.298642 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.298734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.298734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.298897 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.298996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.299082 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.299190 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.299287 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.299380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.299475 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.299570 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.299663 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.299750 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.299848 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.299938 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.300023 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.300115 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.300115 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.300346 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.300455 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.300552 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.300646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.300738 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.300830 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.300916 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.301009 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.301094 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.301179 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.301259 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.301331 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.301402 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.301482 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.301572 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.301658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.301742 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.301841 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.302006 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.302100 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.302194 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.302279 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.302363 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.302454 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.302547 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.302634 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.302726 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.302819 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.302911 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.303003 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.303096 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.303181 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.303273 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.303358 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.303449 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.303541 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.303635 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.303721 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.303805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.303896 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.303989 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.303989 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.304171 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.304257 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.304472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.304588 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.304711 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.304842 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.304957 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.305069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.305182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.305294 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.305416 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.306030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.306164 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.306279 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.306393 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.306551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.306685 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.306834 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.306968 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.307108 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.307248 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.307424 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.307629 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.307763 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.307906 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.308047 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.308187 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.308347 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.308483 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.308617 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.308748 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.308879 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.309010 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.309641 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.309792 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.309920 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.310060 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.310193 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.310324 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.310464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.310755 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.310901 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.311036 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.311168 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.311318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.311458 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.311580 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.312594 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.312712 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.312797 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.312872 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.312954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.313221 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.313384 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.313469 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.313543 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.313677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.313755 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.313827 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.313899 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.313899 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.314028 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.314120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.314120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.314259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.314334 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.314413 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.314486 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.314578 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.314694 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.314783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.314857 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.314936 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.315017 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.315091 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.315164 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.315235 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.315306 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.315385 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.315467 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.315541 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.315614 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.315692 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.315809 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.315897 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.315980 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.316061 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.316135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.316207 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.316314 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.316395 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.316481 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.316556 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.316635 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.316708 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.316780 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.316923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.316998 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.317069 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.317141 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.317212 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.317284 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.317368 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.317442 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.317514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.317586 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.317666 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.317746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.317882 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.317963 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.318044 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.318118 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.318191 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.318269 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.318355 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.318436 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.318526 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.318668 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.318792 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.318792 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.318998 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.319087 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.319179 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.319179 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.319343 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.319442 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.319530 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.319624 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.319717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.319803 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.319928 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.320081 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.320215 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.320215 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.320688 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.320832 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.320925 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.321021 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.321108 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.321258 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.321395 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.321486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.321486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.321486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.321857 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.321857 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.322071 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.322239 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.322345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.322433 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.322519 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.322612 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.322699 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.322796 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.322896 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.322983 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.323067 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.323152 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.323237 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.323336 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.323431 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.323518 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.323518 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.323518 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.323518 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.323792 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.324057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.324158 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.324235 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.324235 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.324235 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.324235 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.330600 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.330689 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.330775 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.330860 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.330860 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.331036 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.331124 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.331217 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.331304 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.331397 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.331483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.331580 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.331674 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.331761 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.331851 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.331938 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.332029 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.332128 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.332214 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.332331 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.332435 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.332529 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.332629 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.332715 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.332814 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.332901 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.333248 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.333248 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.333432 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.333521 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.333615 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.333709 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.333807 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.333894 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.333987 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.334081 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.334168 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.334168 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.334330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.334425 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.334511 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.334603 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.334689 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.334774 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.334859 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.334952 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.335046 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.335133 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.335218 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.335309 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.335403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.335498 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.335585 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.335684 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.335778 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.335865 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.335865 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.336027 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.336114 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.336206 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.336328 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.336407 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.336479 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.336577 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.336577 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.336756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.336876 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.337031 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.337156 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.337279 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.337383 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.337478 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.337573 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.337573 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.338248 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.338342 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.338429 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.338524 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.338620 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.338708 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.338790 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.338790 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.338933 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.339020 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.339114 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.339202 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.339302 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.339390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.339484 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.339578 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.339724 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.339825 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.339952 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.340082 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.340335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.340438 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.340528 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.340603 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.340750 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.340842 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.340937 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.341033 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.341120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.341206 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.341330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.341446 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.341560 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.341747 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.341845 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.341939 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.342027 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.342112 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.342205 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.342305 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.342399 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.342493 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.342587 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.342681 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.342681 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.342947 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.343037 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.343123 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.343216 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.343310 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.343405 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.343493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.343586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.343680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.343774 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.343868 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.343966 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.344055 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.344137 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.344223 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.344408 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.344506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.344602 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.344689 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.344775 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.344867 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.344954 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.345039 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.345133 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.345220 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.345312 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.345405 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.345492 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.345590 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.345684 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.345771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.345857 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.345942 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.346042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.346138 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.346225 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.346299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.346391 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.346478 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.346559 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.346657 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.346752 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.346845 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.346939 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.347034 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.347127 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.347222 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.347308 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.347394 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.347479 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.347573 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.347672 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.347759 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.347844 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.347938 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.348026 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.348111 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.348205 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.348308 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.348396 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.348484 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.348570 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.348655 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.348758 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.348854 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.348996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.349129 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.349227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.349442 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.349553 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.349845 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.349965 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.350104 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.350233 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.350430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.350528 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.350746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.350850 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.351064 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.351178 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.351378 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.351520 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.351695 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.351789 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.352011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.352114 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.352365 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.352504 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.352745 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.352910 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.353017 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.353105 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.353291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.353439 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.354166 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.354262 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.354478 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.354736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.354832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.355070 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.355180 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.355385 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.355486 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.355693 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.355796 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.356006 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.356110 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.356339 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.356487 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.356657 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.356778 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.356971 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.357065 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.357282 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.357385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.357600 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.357707 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.357910 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.358048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.358226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.358374 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.358536 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.358642 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.358862 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.358955 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.359185 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.359296 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.359506 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.359618 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.359820 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.359945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.360138 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.360253 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.364738 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.364909 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.364909 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.365103 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.365203 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.365304 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.365304 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.365464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.365558 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.365652 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.365748 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.365851 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.365935 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.366023 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.366100 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.366187 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.366274 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.366349 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.366422 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.366501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.366582 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.366663 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.366745 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.366745 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.366877 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.366950 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.367029 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.367125 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.367212 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.367298 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.367383 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.367469 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.367556 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.367654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.367742 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.367827 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.367921 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.368008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.368159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.368256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.368370 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.368370 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.368543 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.368630 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.368724 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.368811 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.368899 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.369114 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.369206 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.369281 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.369368 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.369455 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.369538 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.369612 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.369692 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.369774 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.369902 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.369998 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.370083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.370159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.370259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.370343 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.370420 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.370529 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.370627 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.370763 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.370897 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.371152 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.371279 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.371452 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.371550 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.371923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.372078 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.372223 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.372404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.372544 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.372653 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.372653 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.372825 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.372956 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.373174 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.373276 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.373490 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.373586 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.373817 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.373921 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.374145 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.374246 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.374516 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.374620 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.374826 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.374921 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.375151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.375246 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.375459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.375564 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.375768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.375863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.376085 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.376188 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.376428 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.376640 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.376745 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.376964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.377068 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.377306 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.377400 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.377627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.377721 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.377929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.378025 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.378240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.378353 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.378543 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.378645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.378871 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.378967 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.379192 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.379340 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.379482 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.379579 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.379787 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.379892 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.380100 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.380204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.380427 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.380542 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.380784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.380936 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.381061 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.381212 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.381424 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.381562 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.381765 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.381925 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.382059 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.382184 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.382307 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.382513 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.382677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.383455 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.383583 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.383682 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.383770 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.383857 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.383942 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.384077 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.384172 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.384305 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.384397 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.384497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.384614 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.384715 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.384804 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.384988 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.385110 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.385299 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.385413 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.385619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.385724 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.385929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.386032 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.386240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.386347 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.386585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.386681 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.386900 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.387001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.387225 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.387440 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.387537 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.387774 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.387877 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.388094 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.388243 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.388452 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.388611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.388786 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.388882 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.389091 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.389193 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.389397 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.389492 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.389702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.389804 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.390011 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.390119 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.390323 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.390426 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.390633 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.390728 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.390947 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.391102 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.391256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.391419 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.391567 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.391667 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.391948 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.392107 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.392258 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.392441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.392584 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.392745 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.392894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.393044 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.393193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.393339 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.393478 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.393634 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.393790 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.393933 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.394074 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.394215 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.394356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.394496 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.394651 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.394795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.394943 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.395092 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.395242 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.395393 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.395655 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.395756 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.395844 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.395931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.396074 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.396230 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.396406 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.403451 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.403552 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.403552 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.403712 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.403807 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.403897 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.403984 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.404082 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.404171 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.404258 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.404376 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.404465 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.404559 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.404646 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.404740 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.404827 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.404926 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.405013 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.405108 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.405196 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.405282 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.405376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.405471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.405558 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.405651 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.405738 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.405824 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.405918 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.406012 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.406107 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.406194 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.406280 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.406365 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.406466 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.406562 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.406657 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.406745 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.406843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.406943 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.407031 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.407124 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.407211 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.407304 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.407391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.407486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.407580 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.407668 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.407760 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.407847 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.407940 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.408036 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.408133 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.408220 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.408345 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.408434 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.408538 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.408634 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.408727 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.408819 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.408918 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.409006 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.409088 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.409181 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.409257 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.409349 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.409436 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.409521 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.409668 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.409770 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.409858 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.409944 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.409944 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.410101 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.410196 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.410290 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.410384 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.410471 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.410556 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.410654 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.410748 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.410846 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.410945 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.411076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.411180 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.411302 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.411400 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.411498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.411769 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.411876 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.411963 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.412210 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.412330 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.412420 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.412496 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.412569 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.412651 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.412733 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.412815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.412889 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.412968 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.412968 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.413133 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.413229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.413315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.413408 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.413502 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.413589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.413687 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.413895 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.413999 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.414209 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.414305 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.414518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.414621 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.414849 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.414945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.415158 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.415262 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.415465 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.415574 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.415773 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.415907 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.416648 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.416759 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.416961 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.417058 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.417270 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.417373 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.417580 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.417675 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.417892 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.417989 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.418207 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.418303 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.418516 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.418653 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.418828 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.418924 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.419136 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.419239 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.419446 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.419554 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.419754 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.419856 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.420061 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.420155 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.420408 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.420519 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.420719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.420815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.421026 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.421121 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.421336 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.421441 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.421709 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.421864 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.421988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.422083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.422263 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.422382 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.422571 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.422680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.422901 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.423009 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.423207 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.423364 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.423518 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.423666 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.423828 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.423975 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.424129 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.424295 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.424479 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.424576 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.424807 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.424978 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.425129 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.425231 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.425446 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.425542 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.425783 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.425888 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.426099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.426204 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.426414 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.426515 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.426730 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.426837 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.427047 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.427150 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.427298 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 13:24:36.427406 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.427663 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.427997 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.428355 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.428671 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.429004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.429330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.429656 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.429979 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.430298 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.430635 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.430953 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.431271 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.431616 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.431936 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.432256 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.432606 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.432925 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.433268 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.433575 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.433900 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.434823 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.435169 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.435495 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.435833 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.436170 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.436571 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.436897 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.437251 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.437589 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.437914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.438235 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.438547 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:24:36.438795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 13:24:36.489433 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO dbcounter [None req-1bf3f2d3-e8ef-4984-bfe8-c1bcd937c705 None None] Registered counter for database nova_api Oct 24 13:24:36.501548 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO dbcounter [None req-ee21cb4d-6411-4f1a-b674-19268867e16f None None] Registered counter for database nova_api Oct 24 13:24:36.509240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_db.sqlalchemy.engines [None req-1bf3f2d3-e8ef-4984-bfe8-c1bcd937c705 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119145) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:24:36.516067 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writer thread running {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:24:36.521341 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_db.sqlalchemy.engines [None req-ee21cb4d-6411-4f1a-b674-19268867e16f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:24:36.528669 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writer thread running {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:24:36.573121 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.context [None req-1bf3f2d3-e8ef-4984-bfe8-c1bcd937c705 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),12340954-03b2-46f2-a6e0-59bc7b2721c7(cell1) {{(pid=119145) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 13:24:36.577187 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1bf3f2d3-e8ef-4984-bfe8-c1bcd937c705 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:24:36.577655 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1bf3f2d3-e8ef-4984-bfe8-c1bcd937c705 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:24:36.579224 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1bf3f2d3-e8ef-4984-bfe8-c1bcd937c705 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:24:36.579938 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1bf3f2d3-e8ef-4984-bfe8-c1bcd937c705 None None] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:24:36.580403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1bf3f2d3-e8ef-4984-bfe8-c1bcd937c705 None None] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:24:36.582386 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1bf3f2d3-e8ef-4984-bfe8-c1bcd937c705 None None] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:24:36.584682 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO dbcounter [None req-1bf3f2d3-e8ef-4984-bfe8-c1bcd937c705 None None] Registered counter for database nova_cell0 Oct 24 13:24:36.585821 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.context [None req-ee21cb4d-6411-4f1a-b674-19268867e16f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),12340954-03b2-46f2-a6e0-59bc7b2721c7(cell1) {{(pid=119146) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 13:24:36.589334 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO dbcounter [None req-1bf3f2d3-e8ef-4984-bfe8-c1bcd937c705 None None] Registered counter for database nova_cell1 Oct 24 13:24:36.590623 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee21cb4d-6411-4f1a-b674-19268867e16f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:24:36.591098 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee21cb4d-6411-4f1a-b674-19268867e16f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:24:36.592783 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee21cb4d-6411-4f1a-b674-19268867e16f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:24:36.593664 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee21cb4d-6411-4f1a-b674-19268867e16f None None] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:24:36.593961 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee21cb4d-6411-4f1a-b674-19268867e16f None None] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:24:36.597679 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee21cb4d-6411-4f1a-b674-19268867e16f None None] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:24:36.597872 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_db.sqlalchemy.engines [None req-1bf3f2d3-e8ef-4984-bfe8-c1bcd937c705 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119145) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:24:36.598130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO dbcounter [None req-ee21cb4d-6411-4f1a-b674-19268867e16f None None] Registered counter for database nova_cell0 Oct 24 13:24:36.598857 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_db.sqlalchemy.engines [None req-1bf3f2d3-e8ef-4984-bfe8-c1bcd937c705 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119145) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:24:36.602360 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO dbcounter [None req-ee21cb4d-6411-4f1a-b674-19268867e16f None None] Registered counter for database nova_cell1 Oct 24 13:24:36.603471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writer thread running {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:24:36.609947 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_db.sqlalchemy.engines [None req-ee21cb4d-6411-4f1a-b674-19268867e16f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:24:36.611189 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_db.sqlalchemy.engines [None req-ee21cb4d-6411-4f1a-b674-19268867e16f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:24:36.616773 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writer thread running {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:24:36.619999 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writer thread running {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:24:36.742781 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writer thread running {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:24:36.753353 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO dbcounter [None req-1bf3f2d3-e8ef-4984-bfe8-c1bcd937c705 None None] Registered counter for database nova_cell0 Oct 24 13:24:36.761216 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_db.sqlalchemy.engines [None req-1bf3f2d3-e8ef-4984-bfe8-c1bcd937c705 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119145) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:24:36.767215 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writer thread running {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:24:36.768222 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO dbcounter [None req-ee21cb4d-6411-4f1a-b674-19268867e16f None None] Registered counter for database nova_cell0 Oct 24 13:24:36.775004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_db.sqlalchemy.engines [None req-ee21cb4d-6411-4f1a-b674-19268867e16f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:24:36.780445 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writer thread running {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:24:37.093065 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: WARNING keystonemiddleware.auth_token [None req-1bf3f2d3-e8ef-4984-bfe8-c1bcd937c705 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:24:37.100420 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: WARNING keystonemiddleware.auth_token [None req-1bf3f2d3-e8ef-4984-bfe8-c1bcd937c705 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:24:37.104250 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: WARNING keystonemiddleware.auth_token [None req-ee21cb4d-6411-4f1a-b674-19268867e16f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:24:37.111529 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: WARNING keystonemiddleware.auth_token [None req-ee21cb4d-6411-4f1a-b674-19268867e16f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:24:37.443801 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: WARNING keystonemiddleware.auth_token [None req-1bf3f2d3-e8ef-4984-bfe8-c1bcd937c705 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:24:37.449875 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: WARNING keystonemiddleware.auth_token [None req-1bf3f2d3-e8ef-4984-bfe8-c1bcd937c705 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:24:37.455184 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b5a37309c0 pid: 119145 (default app) Oct 24 13:24:37.457587 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: WARNING keystonemiddleware.auth_token [None req-ee21cb4d-6411-4f1a-b674-19268867e16f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:24:37.463893 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: WARNING keystonemiddleware.auth_token [None req-ee21cb4d-6411-4f1a-b674-19268867e16f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:24:37.469230 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b5a37309c0 pid: 119146 (default app) Oct 24 13:25:14.361820 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=3 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:14.363429 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=3 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:14.364234 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=3 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:14.371034 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=3 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:14.767055 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=3 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:14.768598 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=3 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:14.769671 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=3 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:14.770601 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=3 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:15.651803 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9c168f9b-3be1-44df-b882-f95c030f6335 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Action: 'create', calling method: .version_select at 0x7f17a90b4f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1234424943"}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:25:16.005024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-cbbf7277-9409-417f-b0c1-1839de6b531f tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] Action: 'create', calling method: .version_select at 0x7f17a90d3940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1028323228", "metadata": {"Type": "work"}}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-cbbf7277-9409-417f-b0c1-1839de6b531f tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] Request method failure captured: Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 122 Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpI685TonKN3AIt8m25SaqcrmHPiLvbqYmpTlm5Z3jIEkT4lrG23dmvCmHOPsYhsQoJlQQYbR0b6FL4gekURkhsGD_9Aycur5uuGYadqXMTAh9RqoXci-l3KTInOURKE2mYnW6AZuNssITpO9tTUQO62rPIT3lBfBrdZGIJWuN5cYXg Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 9b9bec5e97434a5a89f496d2349549df Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-VolumesNegativeTest-199859097 Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:25:16.014072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:25:16.015535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9b9bec5e97434a5a89f496d2349549df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9b9bec5e97434a5a89f496d2349549df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9b9bec5e97434a5a89f496d2349549df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9b9bec5e97434a5a89f496d2349549df"}]}] Oct 24 13:25:16.015535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-VolumesNegativeTest-199859097 Oct 24 13:25:16.015535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 9b9bec5e97434a5a89f496d2349549df Oct 24 13:25:16.015535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-VolumesNegativeTest-199859097 Oct 24 13:25:16.015535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-VolumesNegativeTest-199859097-project Oct 24 13:25:16.015535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:25:16.015535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:25:16.015535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 601cc4a65cee4a86a421da37f6a980cb Oct 24 13:25:16.015535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-VolumesNegativeTest-199859097-project Oct 24 13:25:16.015535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Oct 24 13:25:16.015535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1028323228", "metadata": {"Type": "work"}}} Oct 24 13:25:16.015535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: Oct 24 13:25:16.015535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1028323228', 'metadata': {'Type': 'work'}}}} Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise error Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi '#$%' Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:25:16.016456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:25:16.017837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:25:16.017837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:25:16.017837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:25:16.017837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:25:16.017837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 13:25:16.017837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 13:25:16.017837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 13:25:16.017837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 13:25:16.017837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 13:25:16.017837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 13:25:16.017837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 24 13:25:16.017837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.017837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:16.017837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.017837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:16.017837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:25:16.017837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:25:16.017837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 13:25:16.017837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 13:25:16.019092 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 24 13:25:16.019092 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.022740 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-cbbf7277-9409-417f-b0c1-1839de6b531f tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:25:16.023972 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-cbbf7277-9409-417f-b0c1-1839de6b531f tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.267422 Oct 24 13:25:16.024983 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Oct 24 13:25:14 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1270 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:25:16.042826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f6572951-7d7e-4aec-a2da-041607b622a6 tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] Action: 'create', calling method: .version_select at 0x7f17a9075c10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-694429956", "metadata": {"Type": "work"}}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f6572951-7d7e-4aec-a2da-041607b622a6 tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] Request method failure captured: Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 119 Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpI685TonKN3AIt8m25SaqcrmHPiLvbqYmpTlm5Z3jIEkT4lrG23dmvCmHOPsYhsQoJlQQYbR0b6FL4gekURkhsGD_9Aycur5uuGYadqXMTAh9RqoXci-l3KTInOURKE2mYnW6AZuNssITpO9tTUQO62rPIT3lBfBrdZGIJWuN5cYXg Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 9b9bec5e97434a5a89f496d2349549df Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-VolumesNegativeTest-199859097 Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:25:16.046766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:25:16.048453 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9b9bec5e97434a5a89f496d2349549df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9b9bec5e97434a5a89f496d2349549df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9b9bec5e97434a5a89f496d2349549df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9b9bec5e97434a5a89f496d2349549df"}]}] Oct 24 13:25:16.048453 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-VolumesNegativeTest-199859097 Oct 24 13:25:16.048453 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 9b9bec5e97434a5a89f496d2349549df Oct 24 13:25:16.048453 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-VolumesNegativeTest-199859097 Oct 24 13:25:16.048453 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-VolumesNegativeTest-199859097-project Oct 24 13:25:16.048453 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:25:16.048453 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:25:16.048453 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 601cc4a65cee4a86a421da37f6a980cb Oct 24 13:25:16.048453 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-VolumesNegativeTest-199859097-project Oct 24 13:25:16.048453 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Oct 24 13:25:16.048453 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-694429956", "metadata": {"Type": "work"}}} Oct 24 13:25:16.048453 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: Oct 24 13:25:16.048453 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-694429956', 'metadata': {'Type': 'work'}}}} Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise error Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi '0' Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:25:16.049337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:25:16.051691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:25:16.051691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:25:16.051691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:25:16.051691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:25:16.051691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 13:25:16.051691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 13:25:16.051691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 13:25:16.051691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 13:25:16.051691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 13:25:16.051691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 13:25:16.051691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 24 13:25:16.051691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.051691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:16.051691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.051691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:16.051691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:25:16.051691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:25:16.051691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 13:25:16.051691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 13:25:16.053574 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 24 13:25:16.053574 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.053574 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f6572951-7d7e-4aec-a2da-041607b622a6 tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:25:16.059304 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f6572951-7d7e-4aec-a2da-041607b622a6 tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021161 Oct 24 13:25:16.059304 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 2/2] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Oct 24 13:25:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:25:16.068760 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ea2f3e5f-c72d-4df0-92b9-c0312b3f69d0 tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] Action: 'create', calling method: .version_select at 0x7f17a902dca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-425405911", "metadata": {"Type": "work"}}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ea2f3e5f-c72d-4df0-92b9-c0312b3f69d0 tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] Request method failure captured: Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 118 Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpI685TonKN3AIt8m25SaqcrmHPiLvbqYmpTlm5Z3jIEkT4lrG23dmvCmHOPsYhsQoJlQQYbR0b6FL4gekURkhsGD_9Aycur5uuGYadqXMTAh9RqoXci-l3KTInOURKE2mYnW6AZuNssITpO9tTUQO62rPIT3lBfBrdZGIJWuN5cYXg Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 9b9bec5e97434a5a89f496d2349549df Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-VolumesNegativeTest-199859097 Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:25:16.084315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:25:16.086001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9b9bec5e97434a5a89f496d2349549df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9b9bec5e97434a5a89f496d2349549df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9b9bec5e97434a5a89f496d2349549df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9b9bec5e97434a5a89f496d2349549df"}]}] Oct 24 13:25:16.086001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-VolumesNegativeTest-199859097 Oct 24 13:25:16.086001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 9b9bec5e97434a5a89f496d2349549df Oct 24 13:25:16.086001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-VolumesNegativeTest-199859097 Oct 24 13:25:16.086001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-VolumesNegativeTest-199859097-project Oct 24 13:25:16.086001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:25:16.086001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:25:16.086001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 601cc4a65cee4a86a421da37f6a980cb Oct 24 13:25:16.086001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-VolumesNegativeTest-199859097-project Oct 24 13:25:16.086001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Oct 24 13:25:16.086001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-425405911", "metadata": {"Type": "work"}}} Oct 24 13:25:16.086001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: Oct 24 13:25:16.086001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-425405911', 'metadata': {'Type': 'work'}}}} Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise error Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi '' Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:25:16.086966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:25:16.089043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:25:16.089043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:25:16.089043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:25:16.089043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:25:16.089043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 13:25:16.089043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 13:25:16.089043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 13:25:16.089043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 13:25:16.089043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 13:25:16.089043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 13:25:16.089043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 24 13:25:16.089043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.089043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:16.089043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.089043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:16.089043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:25:16.089043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:25:16.089043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 13:25:16.089043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 13:25:16.090635 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 24 13:25:16.090635 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.090635 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ea2f3e5f-c72d-4df0-92b9-c0312b3f69d0 tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:25:16.090635 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-ea2f3e5f-c72d-4df0-92b9-c0312b3f69d0 tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026510 Oct 24 13:25:16.090635 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 3/3] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Oct 24 13:25:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:25:16.105149 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c37d6335-4696-4481-997f-bcbb6d4cb5e4 tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] Calling method '.version_select at 0x7f17a902dca0>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:16.748013 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-c37d6335-4696-4481-997f-bcbb6d4cb5e4 tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] HTTP exception thrown: Volume tempest-invalid-314326567 could not be found. Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c37d6335-4696-4481-997f-bcbb6d4cb5e4 tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] Request method failure captured: Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-314326567 HTTP/1.1 Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpI685TonKN3AIt8m25SaqcrmHPiLvbqYmpTlm5Z3jIEkT4lrG23dmvCmHOPsYhsQoJlQQYbR0b6FL4gekURkhsGD_9Aycur5uuGYadqXMTAh9RqoXci-l3KTInOURKE2mYnW6AZuNssITpO9tTUQO62rPIT3lBfBrdZGIJWuN5cYXg Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 9b9bec5e97434a5a89f496d2349549df Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-VolumesNegativeTest-199859097 Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:25:16.758510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:25:16.760130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9b9bec5e97434a5a89f496d2349549df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9b9bec5e97434a5a89f496d2349549df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9b9bec5e97434a5a89f496d2349549df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9b9bec5e97434a5a89f496d2349549df"}]}] Oct 24 13:25:16.760130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-VolumesNegativeTest-199859097 Oct 24 13:25:16.760130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 9b9bec5e97434a5a89f496d2349549df Oct 24 13:25:16.760130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-VolumesNegativeTest-199859097 Oct 24 13:25:16.760130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-VolumesNegativeTest-199859097-project Oct 24 13:25:16.760130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:25:16.760130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:25:16.760130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 601cc4a65cee4a86a421da37f6a980cb Oct 24 13:25:16.760130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-VolumesNegativeTest-199859097-project Oct 24 13:25:16.760130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: Oct 24 13:25:16.760130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Volume tempest-invalid-314326567 could not be found. Oct 24 13:25:16.760130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': 'tempest-invalid-314326567'} Oct 24 13:25:16.760130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:25:16.761120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:16.761120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:25:16.761120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:25:16.761120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 13:25:16.761120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 13:25:16.761120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 13:25:16.761120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 13:25:16.761120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 13:25:16.761120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 13:25:16.761120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 13:25:16.761120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 13:25:16.761120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:25:16.761120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:25:16.761120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:25:16.761120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:25:16.761120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-314326567 could not be found. (HTTP 404) (Request-ID: req-91e12ff4-d7f8-4a99-b26b-95a3414a52f3) Oct 24 13:25:16.761120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.761120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:16.761120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.762464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:16.762464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 24 13:25:16.762464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 24 13:25:16.762464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:25:16.762464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:25:16.762464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:25:16.762464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:25:16.762464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:25:16.762464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:25:16.762464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:25:16.762464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:25:16.762464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 13:25:16.762464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 13:25:16.762464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 13:25:16.762464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 13:25:16.762464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 13:25:16.762464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 13:25:16.762464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 13:25:16.762464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 13:25:16.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:25:16.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:25:16.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:25:16.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:25:16.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-314326567 could not be found. Oct 24 13:25:16.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:16.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:16.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:25:16.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:25:16.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:25:16.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:25:16.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:25:16.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:25:16.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:25:16.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:25:16.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 24 13:25:16.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:25:16.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-314326567 could not be found. Oct 24 13:25:16.765080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.765080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:16.765080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.765080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:16.765080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:25:16.765080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:25:16.765080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:25:16.765080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:25:16.765080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-314326567 could not be found. Oct 24 13:25:16.765080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:16.765080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c37d6335-4696-4481-997f-bcbb6d4cb5e4 tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] Returning 404 to user: Volume tempest-invalid-314326567 could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:25:16.765080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c37d6335-4696-4481-997f-bcbb6d4cb5e4 tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-314326567" status: 404 len: 98 microversion: 2.1 time: 0.654554 Oct 24 13:25:16.765080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 4/4] 10.222.0.48 () {58 vars in 1215 bytes} [Mon Oct 24 13:25:16 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-314326567 => generated 98 bytes in 656 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 24 13:25:16.772452 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1ed8cb14-cf17-4fb5-8fe3-3d32ddd89586 tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006899 Oct 24 13:25:16.773615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 5/5] 10.222.0.48 () {58 vars in 1140 bytes} [Mon Oct 24 13:25:16 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 24 13:25:16.785622 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9e2d5f27-9574-444b-aefb-9f1116aaf47b tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006485 Oct 24 13:25:16.787205 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 6/6] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 24 13:25:16 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 24 13:25:16.799373 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ac3c9f49-edbd-4778-83bd-eff0ef95aa30 tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] Calling method '.version_select at 0x7f17a8f22af0>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:17.095194 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-ac3c9f49-edbd-4778-83bd-eff0ef95aa30 tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] HTTP exception thrown: Volume f89e6001-6573-4e69-b7ae-190670e30f2f could not be found. Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ac3c9f49-edbd-4778-83bd-eff0ef95aa30 tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] Request method failure captured: Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: DELETE /compute/v2.1/os-volumes/f89e6001-6573-4e69-b7ae-190670e30f2f HTTP/1.1 Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpI685TonKN3AIt8m25SaqcrmHPiLvbqYmpTlm5Z3jIEkT4lrG23dmvCmHOPsYhsQoJlQQYbR0b6FL4gekURkhsGD_9Aycur5uuGYadqXMTAh9RqoXci-l3KTInOURKE2mYnW6AZuNssITpO9tTUQO62rPIT3lBfBrdZGIJWuN5cYXg Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 9b9bec5e97434a5a89f496d2349549df Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-VolumesNegativeTest-199859097 Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:25:17.097771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:25:17.099330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9b9bec5e97434a5a89f496d2349549df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9b9bec5e97434a5a89f496d2349549df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9b9bec5e97434a5a89f496d2349549df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9b9bec5e97434a5a89f496d2349549df"}]}] Oct 24 13:25:17.099330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-VolumesNegativeTest-199859097 Oct 24 13:25:17.099330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 9b9bec5e97434a5a89f496d2349549df Oct 24 13:25:17.099330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-VolumesNegativeTest-199859097 Oct 24 13:25:17.099330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-VolumesNegativeTest-199859097-project Oct 24 13:25:17.099330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:25:17.099330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:25:17.099330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 601cc4a65cee4a86a421da37f6a980cb Oct 24 13:25:17.099330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-VolumesNegativeTest-199859097-project Oct 24 13:25:17.099330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: Oct 24 13:25:17.099330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Volume f89e6001-6573-4e69-b7ae-190670e30f2f could not be found. Oct 24 13:25:17.099330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': 'f89e6001-6573-4e69-b7ae-190670e30f2f'} Oct 24 13:25:17.099330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:25:17.100201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:17.100201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:25:17.100201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:25:17.100201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 13:25:17.100201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 13:25:17.100201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 13:25:17.100201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 13:25:17.100201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 13:25:17.100201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 13:25:17.100201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 13:25:17.100201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 13:25:17.100201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:25:17.100201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:25:17.100201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:25:17.100201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:25:17.100201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f89e6001-6573-4e69-b7ae-190670e30f2f could not be found. (HTTP 404) (Request-ID: req-ee8fc267-6323-413f-ac26-d3af18e3de4e) Oct 24 13:25:17.100201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:17.100201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:17.100201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:17.102385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:17.102385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 24 13:25:17.102385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 24 13:25:17.102385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:25:17.102385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:25:17.102385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:25:17.102385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:25:17.102385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:25:17.102385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:25:17.102385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:25:17.102385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:25:17.102385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 13:25:17.102385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 13:25:17.102385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 13:25:17.102385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 13:25:17.102385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 13:25:17.102385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 13:25:17.102385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 13:25:17.102385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 13:25:17.103504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:25:17.103504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:25:17.103504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:25:17.103504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:25:17.103504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f89e6001-6573-4e69-b7ae-190670e30f2f could not be found. Oct 24 13:25:17.103504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:17.103504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:17.103504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:17.103504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:17.103504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:25:17.103504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:25:17.103504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:25:17.103504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:25:17.103504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:25:17.103504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:25:17.103504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:25:17.103504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:25:17.103504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 24 13:25:17.103504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:25:17.106198 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f89e6001-6573-4e69-b7ae-190670e30f2f could not be found. Oct 24 13:25:17.106198 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:17.106198 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:17.106198 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:17.106198 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:17.106198 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:25:17.106198 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:25:17.106198 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:25:17.106198 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:25:17.106198 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f89e6001-6573-4e69-b7ae-190670e30f2f could not be found. Oct 24 13:25:17.106198 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:17.106198 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ac3c9f49-edbd-4778-83bd-eff0ef95aa30 tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] Returning 404 to user: Volume f89e6001-6573-4e69-b7ae-190670e30f2f could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:25:17.106198 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-ac3c9f49-edbd-4778-83bd-eff0ef95aa30 tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/f89e6001-6573-4e69-b7ae-190670e30f2f" status: 404 len: 109 microversion: 2.1 time: 0.305534 Oct 24 13:25:17.106198 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 7/7] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 24 13:25:16 2022] DELETE /compute/v2.1/os-volumes/f89e6001-6573-4e69-b7ae-190670e30f2f => generated 109 bytes in 307 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:25:17.109112 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f37d9dc9-f15c-43ee-af36-6ee14fd918bd tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] Calling method '.version_select at 0x7f17a8e591f0>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:17.936334 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-f37d9dc9-f15c-43ee-af36-6ee14fd918bd tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] HTTP exception thrown: Volume 5ec2d323-6537-4482-88ce-d176b5a4839a could not be found. Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f37d9dc9-f15c-43ee-af36-6ee14fd918bd tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] Request method failure captured: Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: GET /compute/v2.1/os-volumes/5ec2d323-6537-4482-88ce-d176b5a4839a HTTP/1.1 Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpI685TonKN3AIt8m25SaqcrmHPiLvbqYmpTlm5Z3jIEkT4lrG23dmvCmHOPsYhsQoJlQQYbR0b6FL4gekURkhsGD_9Aycur5uuGYadqXMTAh9RqoXci-l3KTInOURKE2mYnW6AZuNssITpO9tTUQO62rPIT3lBfBrdZGIJWuN5cYXg Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 9b9bec5e97434a5a89f496d2349549df Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-VolumesNegativeTest-199859097 Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:25:17.938717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:25:17.940024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9b9bec5e97434a5a89f496d2349549df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9b9bec5e97434a5a89f496d2349549df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9b9bec5e97434a5a89f496d2349549df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9b9bec5e97434a5a89f496d2349549df"}]}] Oct 24 13:25:17.940024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-VolumesNegativeTest-199859097 Oct 24 13:25:17.940024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 9b9bec5e97434a5a89f496d2349549df Oct 24 13:25:17.940024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-VolumesNegativeTest-199859097 Oct 24 13:25:17.940024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-VolumesNegativeTest-199859097-project Oct 24 13:25:17.940024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:25:17.940024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:25:17.940024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 601cc4a65cee4a86a421da37f6a980cb Oct 24 13:25:17.940024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-VolumesNegativeTest-199859097-project Oct 24 13:25:17.940024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: Oct 24 13:25:17.940024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Volume 5ec2d323-6537-4482-88ce-d176b5a4839a could not be found. Oct 24 13:25:17.940024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': '5ec2d323-6537-4482-88ce-d176b5a4839a'} Oct 24 13:25:17.940024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:25:17.940902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:17.940902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:25:17.940902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:25:17.940902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:25:17.940902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:25:17.940902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:25:17.940902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:25:17.940902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:25:17.940902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:25:17.940902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:25:17.940902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:25:17.940902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:25:17.940902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:25:17.940902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:25:17.940902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:25:17.940902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5ec2d323-6537-4482-88ce-d176b5a4839a could not be found. (HTTP 404) (Request-ID: req-c6032dc3-976a-47d3-9274-bb4e80aa1682) Oct 24 13:25:17.940902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:17.940902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:17.940902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:17.942048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:17.942048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 13:25:17.942048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 13:25:17.942048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:25:17.942048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:25:17.942048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:25:17.942048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:25:17.942048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:25:17.942048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:25:17.942048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:25:17.942048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:25:17.942048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:25:17.942048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:25:17.942048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:25:17.942048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:25:17.942048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:25:17.942048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:25:17.942048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:25:17.942048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:25:17.943153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:25:17.943153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:25:17.943153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:25:17.943153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:25:17.943153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5ec2d323-6537-4482-88ce-d176b5a4839a could not be found. Oct 24 13:25:17.943153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:17.943153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:17.943153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:17.943153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:17.943153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:25:17.943153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:25:17.943153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:25:17.943153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:25:17.943153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:25:17.943153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:25:17.943153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:25:17.943153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:25:17.943153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 13:25:17.943153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:25:17.947993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5ec2d323-6537-4482-88ce-d176b5a4839a could not be found. Oct 24 13:25:17.947993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:17.947993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:17.947993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:17.947993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:17.947993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:25:17.947993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:25:17.947993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:25:17.947993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:25:17.947993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5ec2d323-6537-4482-88ce-d176b5a4839a could not be found. Oct 24 13:25:17.947993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:17.947993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f37d9dc9-f15c-43ee-af36-6ee14fd918bd tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] Returning 404 to user: Volume 5ec2d323-6537-4482-88ce-d176b5a4839a could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:25:17.947993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f37d9dc9-f15c-43ee-af36-6ee14fd918bd tempest-VolumesNegativeTest-199859097 tempest-VolumesNegativeTest-199859097-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/5ec2d323-6537-4482-88ce-d176b5a4839a" status: 404 len: 109 microversion: 2.1 time: 0.835617 Oct 24 13:25:17.947993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 8/8] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 24 13:25:17 2022] GET /compute/v2.1/os-volumes/5ec2d323-6537-4482-88ce-d176b5a4839a => generated 109 bytes in 837 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:25:18.061249 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9c168f9b-3be1-44df-b882-f95c030f6335 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.710428 Oct 24 13:25:18.062179 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 1/9] 10.222.0.48 () {60 vars in 1155 bytes} [Mon Oct 24 13:25:14 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3713 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 24 13:25:18.076433 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b4dfd844-91d9-40ac-8929-79ba23d99e1f tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Calling method '.version_select at 0x7f17a902dd30>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:18.174756 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b4dfd844-91d9-40ac-8929-79ba23d99e1f tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/81b7314b-4edc-41ba-b332-78911fad243e" status: 200 len: 345 microversion: 2.1 time: 0.102077 Oct 24 13:25:18.175660 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 9/10] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 24 13:25:18 2022] GET /compute/v2.1/os-volumes/81b7314b-4edc-41ba-b332-78911fad243e => generated 345 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:25:19.190664 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-79e50676-c7fa-4aa0-b53a-1ca3e3a6be80 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Calling method '.version_select at 0x7f17a8f39dc0>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:19.288673 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-79e50676-c7fa-4aa0-b53a-1ca3e3a6be80 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/81b7314b-4edc-41ba-b332-78911fad243e" status: 200 len: 346 microversion: 2.1 time: 0.102329 Oct 24 13:25:19.289494 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 2/11] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 24 13:25:19 2022] GET /compute/v2.1/os-volumes/81b7314b-4edc-41ba-b332-78911fad243e => generated 346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:25:19.308538 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1f708665-b0ff-4b27-9eb6-4b857baf5136 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Action: 'create', calling method: .version_select at 0x7f17a8e59430>, body: {"snapshot": {"volume_id": "81b7314b-4edc-41ba-b332-78911fad243e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1267099851"}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:25:19.955735 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1f708665-b0ff-4b27-9eb6-4b857baf5136 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.656883 Oct 24 13:25:19.956413 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 10/12] 10.222.0.48 () {60 vars in 1162 bytes} [Mon Oct 24 13:25:19 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:25:19.967485 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b237857d-59cf-4a6d-873c-8b25a36a2df0 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Calling method '.version_select at 0x7f17a8ece4c0>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:20.070503 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b237857d-59cf-4a6d-873c-8b25a36a2df0 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb" status: 200 len: 287 microversion: 2.1 time: 0.106560 Oct 24 13:25:20.071930 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 3/13] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 24 13:25:19 2022] GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb => generated 287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:25:20.089533 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9fcf239d-1e08-4510-9a86-a2e4a3e11933 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Calling method '.version_select at 0x7f17a8e634c0>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:20.190669 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9fcf239d-1e08-4510-9a86-a2e4a3e11933 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.111092 Oct 24 13:25:20.191710 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 11/14] 10.222.0.48 () {58 vars in 1140 bytes} [Mon Oct 24 13:25:20 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:25:20.203118 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-70666307-b909-4a53-9d2c-7048ee1342bf tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Calling method '.version_select at 0x7f17a8ecec10>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:20.356105 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-70666307-b909-4a53-9d2c-7048ee1342bf tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb" status: 200 len: 287 microversion: 2.1 time: 0.156971 Oct 24 13:25:20.361273 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 4/15] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 24 13:25:20 2022] GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb => generated 287 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:25:21.371171 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-46c19887-3760-43e4-a59c-7575665a1457 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Calling method '.version_select at 0x7f17a8f22af0>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:21.459674 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-46c19887-3760-43e4-a59c-7575665a1457 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb" status: 200 len: 287 microversion: 2.1 time: 0.094362 Oct 24 13:25:21.460629 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 12/16] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 24 13:25:21 2022] GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:25:22.480538 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-bf37d73c-565e-4d91-b1d1-918d5c3d7477 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Calling method '.version_select at 0x7f17a8eceb80>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:22.601333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-bf37d73c-565e-4d91-b1d1-918d5c3d7477 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb" status: 200 len: 287 microversion: 2.1 time: 0.130977 Oct 24 13:25:22.603909 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 5/17] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 24 13:25:22 2022] GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb => generated 287 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:25:23.616939 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bfd29b94-3248-44ef-bf80-e868d91db7f2 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Calling method '.version_select at 0x7f17a902d670>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:23.687816 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-bfd29b94-3248-44ef-bf80-e868d91db7f2 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb" status: 200 len: 287 microversion: 2.1 time: 0.076349 Oct 24 13:25:23.692776 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 13/18] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 24 13:25:23 2022] GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:25:24.705332 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-01d3c04b-671e-41f9-9ecd-d120ea44fc6e tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Calling method '.version_select at 0x7f17a8ece430>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:24.951995 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-01d3c04b-671e-41f9-9ecd-d120ea44fc6e tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb" status: 200 len: 287 microversion: 2.1 time: 0.254343 Oct 24 13:25:24.952628 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 6/19] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 24 13:25:24 2022] GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb => generated 287 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:25:25.969273 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3d093a2f-0410-4d8f-b8fe-5e71902c9663 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Calling method '.version_select at 0x7f17a8e63040>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:26.103730 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3d093a2f-0410-4d8f-b8fe-5e71902c9663 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb" status: 200 len: 287 microversion: 2.1 time: 0.142286 Oct 24 13:25:26.104966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 14/20] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 24 13:25:25 2022] GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb => generated 287 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:25:27.117004 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-057a720f-12eb-47a7-b379-b8299ccf2b98 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Calling method '.version_select at 0x7f17a8f39ee0>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:27.180960 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-057a720f-12eb-47a7-b379-b8299ccf2b98 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb" status: 200 len: 288 microversion: 2.1 time: 0.067356 Oct 24 13:25:27.187401 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 7/21] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 24 13:25:27 2022] GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb => generated 288 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:25:27.210370 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-012c85e7-2df1-4a6f-994f-8dc721a7f76d tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Calling method '.version_select at 0x7f17a8e3e3a0>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:27.442120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-012c85e7-2df1-4a6f-994f-8dc721a7f76d tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb" status: 202 len: 0 microversion: 2.1 time: 0.248960 Oct 24 13:25:27.442120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 15/22] 10.222.0.48 () {58 vars in 1254 bytes} [Mon Oct 24 13:25:27 2022] DELETE /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 13:25:27.448627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b799412e-8493-44fb-a753-d07383b9d174 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Calling method '.version_select at 0x7f17a8edc310>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:27.501906 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b799412e-8493-44fb-a753-d07383b9d174 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb" status: 200 len: 287 microversion: 2.1 time: 0.058282 Oct 24 13:25:27.502490 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 8/23] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 24 13:25:27 2022] GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:25:28.515222 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f7142569-ec1e-4b75-99ee-b81d343f7330 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Calling method '.version_select at 0x7f17a8f39ee0>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:28.567976 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-f7142569-ec1e-4b75-99ee-b81d343f7330 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] HTTP exception thrown: Snapshot cda477fe-b19b-4959-8dfc-100aac87cdfb could not be found. Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f7142569-ec1e-4b75-99ee-b81d343f7330 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Request method failure captured: Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb HTTP/1.1 Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpI62NEOhOaOrTw5Wp80VTO6kTAGeUIObN2xguPtQgh8DFupgo3egAxmzNRYhQPWcggmpMXXpLi_dkODQaWyWvB3CiLGSDS2bGKHIYSI-2ZcaRQjkhJeUeAqrg0hctnqJkVTtgvLKhuWkPMNSulFbAHV_HSM4pHS15JtfIny3u4XFvk Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: f14cde250a534b1dab61966cb9970c2e Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1561345375 Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:25:28.572639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:25:28.574472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f14cde250a534b1dab61966cb9970c2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f14cde250a534b1dab61966cb9970c2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f14cde250a534b1dab61966cb9970c2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f14cde250a534b1dab61966cb9970c2e"}]}] Oct 24 13:25:28.574472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1561345375 Oct 24 13:25:28.574472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: f14cde250a534b1dab61966cb9970c2e Oct 24 13:25:28.574472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1561345375 Oct 24 13:25:28.574472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-VolumesSnapshotsTestJSON-1561345375-project Oct 24 13:25:28.574472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:25:28.574472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:25:28.574472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 9939003319344ccb8cde9e9e8bab9649 Oct 24 13:25:28.574472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1561345375-project Oct 24 13:25:28.574472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: Oct 24 13:25:28.574472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Snapshot cda477fe-b19b-4959-8dfc-100aac87cdfb could not be found. Oct 24 13:25:28.574472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': 'cda477fe-b19b-4959-8dfc-100aac87cdfb'} Oct 24 13:25:28.574472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:25:28.575495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:28.575495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 24 13:25:28.575495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 24 13:25:28.575495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 24 13:25:28.575495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 24 13:25:28.575495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 24 13:25:28.575495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 24 13:25:28.575495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:25:28.575495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:25:28.575495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:25:28.575495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:25:28.575495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:25:28.575495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:25:28.575495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:25:28.575495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:25:28.575495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cda477fe-b19b-4959-8dfc-100aac87cdfb could not be found. (HTTP 404) (Request-ID: req-37ef7b2b-41b7-4f40-962f-49227eb05986) Oct 24 13:25:28.575495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:28.575495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:28.580589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:28.580589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:28.580589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 24 13:25:28.580589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 24 13:25:28.580589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:25:28.580589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:25:28.580589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 24 13:25:28.580589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 24 13:25:28.580589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:25:28.580589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:25:28.580589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 24 13:25:28.580589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 24 13:25:28.580589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 24 13:25:28.580589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 24 13:25:28.580589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 24 13:25:28.580589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 24 13:25:28.580589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:25:28.580589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:25:28.580589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:25:28.582152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:25:28.582152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:25:28.582152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:25:28.582152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:25:28.582152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:25:28.582152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cda477fe-b19b-4959-8dfc-100aac87cdfb could not be found. Oct 24 13:25:28.582152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:28.582152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:28.582152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:28.582152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:28.582152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:25:28.582152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:25:28.582152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:25:28.582152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:25:28.582152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:25:28.582152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:25:28.582152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:25:28.582152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:25:28.582152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 24 13:25:28.582152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:25:28.583573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cda477fe-b19b-4959-8dfc-100aac87cdfb could not be found. Oct 24 13:25:28.583573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:28.583573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:28.583573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:28.583573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:28.583573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:25:28.583573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:25:28.583573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:25:28.583573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:25:28.583573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cda477fe-b19b-4959-8dfc-100aac87cdfb could not be found. Oct 24 13:25:28.583573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:28.583573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f7142569-ec1e-4b75-99ee-b81d343f7330 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Returning 404 to user: Snapshot cda477fe-b19b-4959-8dfc-100aac87cdfb could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:25:28.583573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f7142569-ec1e-4b75-99ee-b81d343f7330 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb" status: 404 len: 111 microversion: 2.1 time: 0.066299 Oct 24 13:25:28.585695 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 9/24] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 24 13:25:28 2022] GET /compute/v2.1/os-snapshots/cda477fe-b19b-4959-8dfc-100aac87cdfb => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:25:28.592867 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-4627b2a9-2f68-45c9-bd2b-eb1678ca2a7c tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Calling method '.version_select at 0x7f17a98bb550>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:28.620537 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-55e559fb-3f23-4b7a-a561-bbee1f830ff1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Action: 'create', calling method: .version_select at 0x7f17a8e59040>, body: {"keypair": {"name": "tempest-keypair-125058714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfDD/Adzy/epc30pXtlSpa6SW7O8A3+DJd7UlLABd7djTaV/sFP9Of8HTW5tiwMmgop6PXKHH6Dm+9kikQ+9LoMX3rdOVyyEKd3QetTNE3fycVjQ1N4gp7EuGXktqIAgg=="}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:25:28.746631 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-55e559fb-3f23-4b7a-a561-bbee1f830ff1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Getting quotas for project 7fa2196e343c45b5b741c39417ba9ef8. Resources: {'key_pairs'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:25:28.783284 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-55e559fb-3f23-4b7a-a561-bbee1f830ff1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Getting quotas for user 7c096064e6ec443a9e8755bc2e68dbb7 and project 7fa2196e343c45b5b741c39417ba9ef8. Resources: {'key_pairs'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:25:28.984855 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-55e559fb-3f23-4b7a-a561-bbee1f830ff1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.645995 Oct 24 13:25:28.986574 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 16/25] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Oct 24 13:25:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 648 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 24 13:25:28.990407 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-4627b2a9-2f68-45c9-bd2b-eb1678ca2a7c tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/81b7314b-4edc-41ba-b332-78911fad243e" status: 202 len: 0 microversion: 2.1 time: 0.401837 Oct 24 13:25:28.991311 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 10/26] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 24 13:25:28 2022] DELETE /compute/v2.1/os-volumes/81b7314b-4edc-41ba-b332-78911fad243e => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:25:29.012830 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e88f0460-e81b-4a12-8c04-530ec57a779a tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Calling method '.version_select at 0x7f17a8e3ab80>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:29.146839 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e88f0460-e81b-4a12-8c04-530ec57a779a tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/81b7314b-4edc-41ba-b332-78911fad243e" status: 200 len: 345 microversion: 2.1 time: 0.139675 Oct 24 13:25:29.154186 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 17/27] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 24 13:25:29 2022] GET /compute/v2.1/os-volumes/81b7314b-4edc-41ba-b332-78911fad243e => generated 345 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:25:30.166548 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a308f6f2-abb0-49e1-b0a5-c5c93512720f tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Calling method '.version_select at 0x7f17a8edc790>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:30.254639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-a308f6f2-abb0-49e1-b0a5-c5c93512720f tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] HTTP exception thrown: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a308f6f2-abb0-49e1-b0a5-c5c93512720f tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Request method failure captured: Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/os-volumes/81b7314b-4edc-41ba-b332-78911fad243e HTTP/1.1 Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpI62NEOhOaOrTw5Wp80VTO6kTAGeUIObN2xguPtQgh8DFupgo3egAxmzNRYhQPWcggmpMXXpLi_dkODQaWyWvB3CiLGSDS2bGKHIYSI-2ZcaRQjkhJeUeAqrg0hctnqJkVTtgvLKhuWkPMNSulFbAHV_HSM4pHS15JtfIny3u4XFvk Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: f14cde250a534b1dab61966cb9970c2e Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1561345375 Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:25:30.258042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:25:30.259513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f14cde250a534b1dab61966cb9970c2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f14cde250a534b1dab61966cb9970c2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f14cde250a534b1dab61966cb9970c2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f14cde250a534b1dab61966cb9970c2e"}]}] Oct 24 13:25:30.259513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1561345375 Oct 24 13:25:30.259513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: f14cde250a534b1dab61966cb9970c2e Oct 24 13:25:30.259513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1561345375 Oct 24 13:25:30.259513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-VolumesSnapshotsTestJSON-1561345375-project Oct 24 13:25:30.259513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:25:30.259513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:25:30.259513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 9939003319344ccb8cde9e9e8bab9649 Oct 24 13:25:30.259513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1561345375-project Oct 24 13:25:30.259513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: Oct 24 13:25:30.259513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. Oct 24 13:25:30.259513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': '81b7314b-4edc-41ba-b332-78911fad243e'} Oct 24 13:25:30.259513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:25:30.260345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:30.260345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:25:30.260345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:25:30.260345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:25:30.260345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:25:30.260345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:25:30.260345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:25:30.260345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:25:30.260345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:25:30.260345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:25:30.260345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:25:30.260345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:25:30.260345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:25:30.260345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:25:30.260345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:25:30.260345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. (HTTP 404) (Request-ID: req-b511af81-a6b7-439a-89ac-d25202f03aa4) Oct 24 13:25:30.260345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.260345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:30.260345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.261551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:30.261551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 13:25:30.261551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 13:25:30.261551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:25:30.261551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:25:30.261551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:25:30.261551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:25:30.261551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:25:30.261551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:25:30.261551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:25:30.261551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:25:30.261551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:25:30.261551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:25:30.261551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:25:30.261551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:25:30.261551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:25:30.261551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:25:30.261551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:25:30.261551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:25:30.262677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:25:30.262677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:25:30.262677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:25:30.262677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:25:30.262677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. Oct 24 13:25:30.262677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.262677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:30.262677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.262677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:30.262677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:25:30.262677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:25:30.262677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:25:30.262677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:25:30.262677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:25:30.262677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:25:30.262677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:25:30.262677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:25:30.262677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 13:25:30.262677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:25:30.263815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. Oct 24 13:25:30.263815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.263815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:30.263815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.263815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:30.263815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:25:30.263815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:25:30.263815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:25:30.263815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:25:30.263815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. Oct 24 13:25:30.263815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.263815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a308f6f2-abb0-49e1-b0a5-c5c93512720f tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Returning 404 to user: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:25:30.263815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a308f6f2-abb0-49e1-b0a5-c5c93512720f tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/81b7314b-4edc-41ba-b332-78911fad243e" status: 404 len: 109 microversion: 2.1 time: 0.101442 Oct 24 13:25:30.263815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 11/28] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 24 13:25:30 2022] GET /compute/v2.1/os-volumes/81b7314b-4edc-41ba-b332-78911fad243e => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:25:30.276448 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-15e5bd79-f73e-49e7-9f6b-e6266e7efa65 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Calling method '.version_select at 0x7f17a8e3ad30>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-15e5bd79-f73e-49e7-9f6b-e6266e7efa65 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] HTTP exception thrown: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-15e5bd79-f73e-49e7-9f6b-e6266e7efa65 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Request method failure captured: Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: DELETE /compute/v2.1/os-volumes/81b7314b-4edc-41ba-b332-78911fad243e HTTP/1.1 Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpI62NEOhOaOrTw5Wp80VTO6kTAGeUIObN2xguPtQgh8DFupgo3egAxmzNRYhQPWcggmpMXXpLi_dkODQaWyWvB3CiLGSDS2bGKHIYSI-2ZcaRQjkhJeUeAqrg0hctnqJkVTtgvLKhuWkPMNSulFbAHV_HSM4pHS15JtfIny3u4XFvk Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: f14cde250a534b1dab61966cb9970c2e Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1561345375 Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:25:30.629611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:25:30.639731 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f14cde250a534b1dab61966cb9970c2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f14cde250a534b1dab61966cb9970c2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f14cde250a534b1dab61966cb9970c2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f14cde250a534b1dab61966cb9970c2e"}]}] Oct 24 13:25:30.639731 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1561345375 Oct 24 13:25:30.639731 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: f14cde250a534b1dab61966cb9970c2e Oct 24 13:25:30.639731 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1561345375 Oct 24 13:25:30.639731 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-VolumesSnapshotsTestJSON-1561345375-project Oct 24 13:25:30.639731 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:25:30.639731 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:25:30.639731 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 9939003319344ccb8cde9e9e8bab9649 Oct 24 13:25:30.639731 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1561345375-project Oct 24 13:25:30.639731 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: Oct 24 13:25:30.639731 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. Oct 24 13:25:30.639731 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': '81b7314b-4edc-41ba-b332-78911fad243e'} Oct 24 13:25:30.639731 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:25:30.650483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:30.650483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:25:30.650483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:25:30.650483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 13:25:30.650483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 13:25:30.650483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 13:25:30.650483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 13:25:30.650483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 13:25:30.650483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 13:25:30.650483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 13:25:30.650483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 13:25:30.650483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:25:30.650483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:25:30.650483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:25:30.650483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:25:30.650483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. (HTTP 404) (Request-ID: req-3a16c919-4243-4048-8f0e-b904173982f4) Oct 24 13:25:30.650483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.650483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:30.650483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.657038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:30.657038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 24 13:25:30.657038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 24 13:25:30.657038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:25:30.657038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:25:30.657038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:25:30.657038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:25:30.657038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:25:30.657038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:25:30.657038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:25:30.657038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:25:30.657038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 13:25:30.657038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 13:25:30.657038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 13:25:30.657038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 13:25:30.657038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 13:25:30.657038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 13:25:30.657038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 13:25:30.657038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 13:25:30.661805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:25:30.661805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:25:30.661805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:25:30.661805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:25:30.661805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. Oct 24 13:25:30.661805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.661805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:30.661805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.661805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:30.661805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:25:30.661805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:25:30.661805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:25:30.661805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:25:30.661805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:25:30.661805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:25:30.661805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:25:30.661805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:25:30.661805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 24 13:25:30.661805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:25:30.667482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. Oct 24 13:25:30.667482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.667482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:30.667482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.667482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:30.667482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:25:30.667482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:25:30.667482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:25:30.667482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:25:30.667482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. Oct 24 13:25:30.667482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.667482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-15e5bd79-f73e-49e7-9f6b-e6266e7efa65 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Returning 404 to user: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:25:30.667482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-15e5bd79-f73e-49e7-9f6b-e6266e7efa65 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/81b7314b-4edc-41ba-b332-78911fad243e" status: 404 len: 109 microversion: 2.1 time: 0.082280 Oct 24 13:25:30.667482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 18/29] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 24 13:25:30 2022] DELETE /compute/v2.1/os-volumes/81b7314b-4edc-41ba-b332-78911fad243e => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7e35780a-0018-4c5c-b110-bc81103f8e36 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Calling method '.version_select at 0x7f17a8eb6550>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-7e35780a-0018-4c5c-b110-bc81103f8e36 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] HTTP exception thrown: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7e35780a-0018-4c5c-b110-bc81103f8e36 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Request method failure captured: Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/os-volumes/81b7314b-4edc-41ba-b332-78911fad243e HTTP/1.1 Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpI62NEOhOaOrTw5Wp80VTO6kTAGeUIObN2xguPtQgh8DFupgo3egAxmzNRYhQPWcggmpMXXpLi_dkODQaWyWvB3CiLGSDS2bGKHIYSI-2ZcaRQjkhJeUeAqrg0hctnqJkVTtgvLKhuWkPMNSulFbAHV_HSM4pHS15JtfIny3u4XFvk Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: f14cde250a534b1dab61966cb9970c2e Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1561345375 Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:25:30.670254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:25:30.677151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f14cde250a534b1dab61966cb9970c2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f14cde250a534b1dab61966cb9970c2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f14cde250a534b1dab61966cb9970c2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f14cde250a534b1dab61966cb9970c2e"}]}] Oct 24 13:25:30.677151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1561345375 Oct 24 13:25:30.677151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: f14cde250a534b1dab61966cb9970c2e Oct 24 13:25:30.677151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1561345375 Oct 24 13:25:30.677151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-VolumesSnapshotsTestJSON-1561345375-project Oct 24 13:25:30.677151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:25:30.677151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:25:30.677151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 9939003319344ccb8cde9e9e8bab9649 Oct 24 13:25:30.677151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1561345375-project Oct 24 13:25:30.677151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: Oct 24 13:25:30.677151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. Oct 24 13:25:30.677151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': '81b7314b-4edc-41ba-b332-78911fad243e'} Oct 24 13:25:30.677151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:25:30.679783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:30.679783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:25:30.679783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:25:30.679783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:25:30.679783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:25:30.679783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:25:30.679783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:25:30.679783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:25:30.679783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:25:30.679783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:25:30.679783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:25:30.679783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:25:30.679783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:25:30.679783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:25:30.679783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:25:30.679783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. (HTTP 404) (Request-ID: req-7b3be57f-9f3e-440d-b8b7-0b93c50ec50b) Oct 24 13:25:30.679783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.679783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:30.679783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.682977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:30.682977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 13:25:30.682977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 13:25:30.682977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:25:30.682977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:25:30.682977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:25:30.682977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:25:30.682977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:25:30.682977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:25:30.682977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:25:30.682977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:25:30.682977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:25:30.682977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:25:30.682977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:25:30.682977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:25:30.682977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:25:30.682977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:25:30.682977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:25:30.682977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:25:30.685996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:25:30.685996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:25:30.685996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:25:30.685996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:25:30.685996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. Oct 24 13:25:30.685996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.685996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:30.685996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.685996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:30.685996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:25:30.685996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:25:30.685996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:25:30.685996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:25:30.685996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:25:30.685996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:25:30.685996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:25:30.685996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:25:30.685996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 13:25:30.685996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:25:30.688756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. Oct 24 13:25:30.688756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.688756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:25:30.688756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.688756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:25:30.688756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:25:30.688756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:25:30.688756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:25:30.688756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:25:30.688756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. Oct 24 13:25:30.688756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:25:30.688756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7e35780a-0018-4c5c-b110-bc81103f8e36 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] Returning 404 to user: Volume 81b7314b-4edc-41ba-b332-78911fad243e could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:25:30.688756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-7e35780a-0018-4c5c-b110-bc81103f8e36 tempest-VolumesSnapshotsTestJSON-1561345375 tempest-VolumesSnapshotsTestJSON-1561345375-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/81b7314b-4edc-41ba-b332-78911fad243e" status: 404 len: 109 microversion: 2.1 time: 0.081057 Oct 24 13:25:30.688756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 12/30] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 24 13:25:30 2022] GET /compute/v2.1/os-volumes/81b7314b-4edc-41ba-b332-78911fad243e => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:25:31.870101 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-fc670f13-9777-4abd-a3b9-ce89f3c2b6e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-122272820", "imageRef": "1a874490-179e-412c-895e-52b16935c04c", "flavorRef": "452", "networks": [{"uuid": "0e6c385a-5176-45cf-b215-cfd3a8bc2b5c"}]}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:25:32.137031 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.network.neutron [None req-fc670f13-9777-4abd-a3b9-ce89f3c2b6e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] validate_networks() for [('0e6c385a-5176-45cf-b215-cfd3a8bc2b5c', None, None, None, None, None)] {{(pid=119146) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:25:32.420604 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-bfbc4a17-f6d3-4493-bba5-64bd48addecc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Action: 'create', calling method: .version_select at 0x7f17a8f39e50>, body: {"keypair": {"name": "tempest-keypair-1331417750", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvC4rmUcXA3pwJATDmNKTI5mwIUVh9CfrQ+r6McxN62xTD8sp+4/32iyYHuZL8DnPhfNUnU04WOvrkDNUavgVjZgIlINWCUiK6IH3puvKrFsnDfnO2WG63tB45zx5etZg=="}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:25:32.583614 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-bfbc4a17-f6d3-4493-bba5-64bd48addecc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Getting quotas for project e3faf7ad1fea4ab8b08c98a10491ec11. Resources: {'key_pairs'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:25:32.598737 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-bfbc4a17-f6d3-4493-bba5-64bd48addecc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Getting quotas for user e0dd5e32e4a642c8ac9e44310e0a6a5b and project e3faf7ad1fea4ab8b08c98a10491ec11. Resources: {'key_pairs'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:25:32.778530 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-bfbc4a17-f6d3-4493-bba5-64bd48addecc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.838505 Oct 24 13:25:32.788259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 13/31] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 24 13:25:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:25:33.353598 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e6f85659-36b5-4741-90d3-d6ee81c07844 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1363468049", "imageRef": "1a874490-179e-412c-895e-52b16935c04c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:25:33.504882 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.network.neutron [None req-e6f85659-36b5-4741-90d3-d6ee81c07844 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] validate_networks() for [('66080719-964f-4fc3-8c4a-84b1c81a6ebc', None, None, None, None, None)] {{(pid=119145) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:25:34.142412 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-fc670f13-9777-4abd-a3b9-ce89f3c2b6e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Flavor limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:25:34.142854 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-fc670f13-9777-4abd-a3b9-ce89f3c2b6e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Image limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:25:34.143236 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-fc670f13-9777-4abd-a3b9-ce89f3c2b6e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Flavor pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:25:34.143705 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-fc670f13-9777-4abd-a3b9-ce89f3c2b6e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Image pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:25:34.144121 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-fc670f13-9777-4abd-a3b9-ce89f3c2b6e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:25:34.156633 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc670f13-9777-4abd-a3b9-ce89f3c2b6e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:34.157117 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc670f13-9777-4abd-a3b9-ce89f3c2b6e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:34.157545 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc670f13-9777-4abd-a3b9-ce89f3c2b6e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:34.158261 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc670f13-9777-4abd-a3b9-ce89f3c2b6e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:34.158711 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc670f13-9777-4abd-a3b9-ce89f3c2b6e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:34.159186 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc670f13-9777-4abd-a3b9-ce89f3c2b6e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:34.186214 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-fc670f13-9777-4abd-a3b9-ce89f3c2b6e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Getting quotas for project 6019625869c249fbae42eff10c82c590. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:25:34.191416 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-fc670f13-9777-4abd-a3b9-ce89f3c2b6e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Getting quotas for user 495ed7e994004db99f1553ab6e0cc65c and project 6019625869c249fbae42eff10c82c590. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:25:34.212689 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-fc670f13-9777-4abd-a3b9-ce89f3c2b6e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Going to run 1 instances... {{(pid=119146) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:25:34.215577 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-fc670f13-9777-4abd-a3b9-ce89f3c2b6e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a874490-179e-412c-895e-52b16935c04c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119146) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:25:34.426873 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-fc670f13-9777-4abd-a3b9-ce89f3c2b6e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.689555 Oct 24 13:25:34.427533 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 19/32] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 24 13:25:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 3691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:25:34.441620 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-d7844ec1-9157-473f-a186-d8db81c5e04d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-65729279", "imageRef": "1a874490-179e-412c-895e-52b16935c04c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "958bd8a2-e988-4f21-ad22-567c0fb9f577"}], "security_groups": [{"name": "tempest-securitygroup--1179116340"}], "key_name": "tempest-keypair-125058714", "user_data": "}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:25:34.650126 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.network.neutron [None req-d7844ec1-9157-473f-a186-d8db81c5e04d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] validate_networks() for [('958bd8a2-e988-4f21-ad22-567c0fb9f577', None, None, None, None, None)] {{(pid=119146) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:25:35.675251 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-e6f85659-36b5-4741-90d3-d6ee81c07844 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Flavor limits 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:25:35.675780 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-e6f85659-36b5-4741-90d3-d6ee81c07844 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Image limits 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:25:35.677413 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-e6f85659-36b5-4741-90d3-d6ee81c07844 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Flavor pref 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:25:35.677413 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-e6f85659-36b5-4741-90d3-d6ee81c07844 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Image pref 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:25:35.677413 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-e6f85659-36b5-4741-90d3-d6ee81c07844 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:25:35.690346 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e6f85659-36b5-4741-90d3-d6ee81c07844 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:35.690868 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e6f85659-36b5-4741-90d3-d6ee81c07844 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:35.691631 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e6f85659-36b5-4741-90d3-d6ee81c07844 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:35.693280 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e6f85659-36b5-4741-90d3-d6ee81c07844 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:35.693841 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e6f85659-36b5-4741-90d3-d6ee81c07844 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:35.694260 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e6f85659-36b5-4741-90d3-d6ee81c07844 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:35.725321 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-e6f85659-36b5-4741-90d3-d6ee81c07844 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Getting quotas for project 986792b802264c748e4614c4d2a17680. Resources: {'ram', 'instances', 'cores'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:25:35.732149 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-e6f85659-36b5-4741-90d3-d6ee81c07844 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Getting quotas for user 633c6c68e15f4be9a7289d15cac9de43 and project 986792b802264c748e4614c4d2a17680. Resources: {'ram', 'instances', 'cores'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:25:35.748643 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e6f85659-36b5-4741-90d3-d6ee81c07844 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Going to run 1 instances... {{(pid=119145) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:25:35.752061 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e6f85659-36b5-4741-90d3-d6ee81c07844 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a874490-179e-412c-895e-52b16935c04c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119145) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:25:35.964200 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e6f85659-36b5-4741-90d3-d6ee81c07844 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.173364 Oct 24 13:25:35.967633 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 14/33] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 24 13:25:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 3178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:25:35.978760 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-cf5a11d4-a8ae-40b2-948b-60f338e552f7 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:35.983532 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-cf5a11d4-a8ae-40b2-948b-60f338e552f7 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:36.195106 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-cf5a11d4-a8ae-40b2-948b-60f338e552f7 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:36.220238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-cf5a11d4-a8ae-40b2-948b-60f338e552f7 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1214 microversion: 2.1 time: 0.250218 Oct 24 13:25:36.221518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 15/34] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:35 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1214 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:36.246588 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f0634167-1866-43fa-93a5-33fe0fd3568c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:36.247279 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f0634167-1866-43fa-93a5-33fe0fd3568c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:36.317529 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f0634167-1866-43fa-93a5-33fe0fd3568c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:36.326524 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f0634167-1866-43fa-93a5-33fe0fd3568c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1222 microversion: 2.1 time: 0.103702 Oct 24 13:25:36.347260 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 16/35] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:36 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1222 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:36.465410 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-d7844ec1-9157-473f-a186-d8db81c5e04d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Flavor limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:25:36.466952 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-d7844ec1-9157-473f-a186-d8db81c5e04d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Image limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:25:36.467568 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-d7844ec1-9157-473f-a186-d8db81c5e04d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Flavor pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:25:36.468121 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-d7844ec1-9157-473f-a186-d8db81c5e04d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Image pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:25:36.468758 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-d7844ec1-9157-473f-a186-d8db81c5e04d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:25:36.483998 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d7844ec1-9157-473f-a186-d8db81c5e04d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:36.487040 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d7844ec1-9157-473f-a186-d8db81c5e04d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:36.488529 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d7844ec1-9157-473f-a186-d8db81c5e04d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:36.490869 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d7844ec1-9157-473f-a186-d8db81c5e04d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:36.492596 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d7844ec1-9157-473f-a186-d8db81c5e04d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:36.494042 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d7844ec1-9157-473f-a186-d8db81c5e04d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:36.539894 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-d7844ec1-9157-473f-a186-d8db81c5e04d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Getting quotas for project 7fa2196e343c45b5b741c39417ba9ef8. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:25:36.548126 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-d7844ec1-9157-473f-a186-d8db81c5e04d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Getting quotas for user 7c096064e6ec443a9e8755bc2e68dbb7 and project 7fa2196e343c45b5b741c39417ba9ef8. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:25:36.565511 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-d7844ec1-9157-473f-a186-d8db81c5e04d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Going to run 1 instances... {{(pid=119146) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:25:36.568478 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-d7844ec1-9157-473f-a186-d8db81c5e04d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a874490-179e-412c-895e-52b16935c04c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119146) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:25:36.777935 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-d7844ec1-9157-473f-a186-d8db81c5e04d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.340177 Oct 24 13:25:36.781132 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 20/36] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Oct 24 13:25:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 2353 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 13:25:36.790470 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0b6f52e3-f86e-465e-bd4c-b61ac94da0df tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:36.791742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0b6f52e3-f86e-465e-bd4c-b61ac94da0df tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:36.819735 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-d083523d-b7db-4bc3-8426-33718d498e24 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1568754360", "imageRef": "1a874490-179e-412c-895e-52b16935c04c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:25:36.974446 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.network.neutron [None req-d083523d-b7db-4bc3-8426-33718d498e24 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] validate_networks() for [('66080719-964f-4fc3-8c4a-84b1c81a6ebc', None, None, None, None, None)] {{(pid=119146) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:25:36.982544 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0b6f52e3-f86e-465e-bd4c-b61ac94da0df tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:37.012928 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0b6f52e3-f86e-465e-bd4c-b61ac94da0df tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:37.017710 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0b6f52e3-f86e-465e-bd4c-b61ac94da0df tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:37.020005 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0b6f52e3-f86e-465e-bd4c-b61ac94da0df tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1279 microversion: 2.20 time: 0.234549 Oct 24 13:25:37.022693 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 17/37] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:25:36 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1279 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:25:37.246008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e358ed6f-2f9a-4765-bf25-2bbbb673d39b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:37.247188 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e358ed6f-2f9a-4765-bf25-2bbbb673d39b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:37.353483 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e358ed6f-2f9a-4765-bf25-2bbbb673d39b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:37.361201 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e358ed6f-2f9a-4765-bf25-2bbbb673d39b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1214 microversion: 2.1 time: 0.121302 Oct 24 13:25:37.376900 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 18/38] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:37 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:37.947387 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-d083523d-b7db-4bc3-8426-33718d498e24 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Flavor limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:25:37.947957 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-d083523d-b7db-4bc3-8426-33718d498e24 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Image limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:25:37.948254 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-d083523d-b7db-4bc3-8426-33718d498e24 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Flavor pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:25:37.949081 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-d083523d-b7db-4bc3-8426-33718d498e24 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Image pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:25:37.949633 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-d083523d-b7db-4bc3-8426-33718d498e24 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:25:37.969369 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d083523d-b7db-4bc3-8426-33718d498e24 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:37.970084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d083523d-b7db-4bc3-8426-33718d498e24 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:37.970687 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d083523d-b7db-4bc3-8426-33718d498e24 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:37.971629 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d083523d-b7db-4bc3-8426-33718d498e24 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:37.972237 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d083523d-b7db-4bc3-8426-33718d498e24 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:37.972680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d083523d-b7db-4bc3-8426-33718d498e24 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:37.999949 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-d083523d-b7db-4bc3-8426-33718d498e24 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Getting quotas for project 986792b802264c748e4614c4d2a17680. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:25:38.007345 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-d083523d-b7db-4bc3-8426-33718d498e24 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Getting quotas for user 633c6c68e15f4be9a7289d15cac9de43 and project 986792b802264c748e4614c4d2a17680. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:25:38.020065 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-d083523d-b7db-4bc3-8426-33718d498e24 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Going to run 1 instances... {{(pid=119146) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:25:38.022453 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-d083523d-b7db-4bc3-8426-33718d498e24 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a874490-179e-412c-895e-52b16935c04c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119146) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:25:38.052981 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a69a95ce-8361-4319-99cd-63009694e4e8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:38.053701 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a69a95ce-8361-4319-99cd-63009694e4e8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:38.184175 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-d083523d-b7db-4bc3-8426-33718d498e24 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.369065 Oct 24 13:25:38.197936 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 21/39] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 24 13:25:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:25:38.219999 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a69a95ce-8361-4319-99cd-63009694e4e8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:38.222548 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7ac85100-689b-42d3-b2da-ae122572ae7c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:38.223252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a69a95ce-8361-4319-99cd-63009694e4e8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:38.223619 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7ac85100-689b-42d3-b2da-ae122572ae7c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:38.234597 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a69a95ce-8361-4319-99cd-63009694e4e8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:38.239571 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a69a95ce-8361-4319-99cd-63009694e4e8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1279 microversion: 2.20 time: 0.190341 Oct 24 13:25:38.240434 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 19/40] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:25:38 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1279 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:25:38.266834 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a0241618-9fd5-473b-863e-09e71be81c18 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-218431969", "imageRef": "1a874490-179e-412c-895e-52b16935c04c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "143f8287-8fb4-4393-ae4f-ca898c17799f"}], "security_groups": [{"name": "tempest-securitygroup--1645433793"}], "key_name": "tempest-keypair-1331417750", "user_data": "}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:25:38.420954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7ac85100-689b-42d3-b2da-ae122572ae7c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:38.438580 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7ac85100-689b-42d3-b2da-ae122572ae7c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1222 microversion: 2.1 time: 0.238848 Oct 24 13:25:38.456347 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 22/41] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:38 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1222 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:38.469304 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-60c2511d-9427-4f5e-877b-18b9c8f40245 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:38.485715 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-60c2511d-9427-4f5e-877b-18b9c8f40245 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:38.511421 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.network.neutron [None req-a0241618-9fd5-473b-863e-09e71be81c18 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] validate_networks() for [('143f8287-8fb4-4393-ae4f-ca898c17799f', None, None, None, None, None)] {{(pid=119145) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:25:38.511566 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-60c2511d-9427-4f5e-877b-18b9c8f40245 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:38.512073 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-60c2511d-9427-4f5e-877b-18b9c8f40245 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:38.512795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-60c2511d-9427-4f5e-877b-18b9c8f40245 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:38.513865 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-60c2511d-9427-4f5e-877b-18b9c8f40245 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:38.514357 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-60c2511d-9427-4f5e-877b-18b9c8f40245 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:38.515952 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-60c2511d-9427-4f5e-877b-18b9c8f40245 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:38.880296 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-60c2511d-9427-4f5e-877b-18b9c8f40245 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:38.893882 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-60c2511d-9427-4f5e-877b-18b9c8f40245 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1266 microversion: 2.1 time: 0.435909 Oct 24 13:25:38.895181 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 23/42] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:38 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1266 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:39.278195 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8a1f24d6-a2e8-44a8-8bdb-0940559a3f80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:39.279306 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8a1f24d6-a2e8-44a8-8bdb-0940559a3f80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:39.286108 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8a1f24d6-a2e8-44a8-8bdb-0940559a3f80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:39.286861 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8a1f24d6-a2e8-44a8-8bdb-0940559a3f80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:39.287463 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8a1f24d6-a2e8-44a8-8bdb-0940559a3f80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:39.288302 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8a1f24d6-a2e8-44a8-8bdb-0940559a3f80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:39.297200 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8a1f24d6-a2e8-44a8-8bdb-0940559a3f80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:39.297200 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8a1f24d6-a2e8-44a8-8bdb-0940559a3f80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:39.409891 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8a1f24d6-a2e8-44a8-8bdb-0940559a3f80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:39.419912 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8a1f24d6-a2e8-44a8-8bdb-0940559a3f80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:39.421630 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8a1f24d6-a2e8-44a8-8bdb-0940559a3f80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:39.422887 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8a1f24d6-a2e8-44a8-8bdb-0940559a3f80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1275 microversion: 2.20 time: 0.150383 Oct 24 13:25:39.423518 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 24/43] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:25:39 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1275 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:25:39.465058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-a0241618-9fd5-473b-863e-09e71be81c18 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Flavor limits 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:25:39.465607 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-a0241618-9fd5-473b-863e-09e71be81c18 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Image limits 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:25:39.466184 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-a0241618-9fd5-473b-863e-09e71be81c18 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Flavor pref 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:25:39.467314 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-52640635-5253-4302-82a4-b0e364b3e739 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:39.467920 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-a0241618-9fd5-473b-863e-09e71be81c18 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Image pref 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:25:39.468352 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-a0241618-9fd5-473b-863e-09e71be81c18 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:25:39.470215 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-52640635-5253-4302-82a4-b0e364b3e739 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:39.479569 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a0241618-9fd5-473b-863e-09e71be81c18 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:39.480042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a0241618-9fd5-473b-863e-09e71be81c18 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:39.480525 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a0241618-9fd5-473b-863e-09e71be81c18 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:39.481383 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a0241618-9fd5-473b-863e-09e71be81c18 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:39.482064 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a0241618-9fd5-473b-863e-09e71be81c18 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:39.482673 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a0241618-9fd5-473b-863e-09e71be81c18 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:39.500875 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-a0241618-9fd5-473b-863e-09e71be81c18 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Getting quotas for project e3faf7ad1fea4ab8b08c98a10491ec11. Resources: {'ram', 'instances', 'cores'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:25:39.504869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-a0241618-9fd5-473b-863e-09e71be81c18 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Getting quotas for user e0dd5e32e4a642c8ac9e44310e0a6a5b and project e3faf7ad1fea4ab8b08c98a10491ec11. Resources: {'ram', 'instances', 'cores'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:25:39.550830 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-52640635-5253-4302-82a4-b0e364b3e739 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:39.552190 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a0241618-9fd5-473b-863e-09e71be81c18 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Going to run 1 instances... {{(pid=119145) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:25:39.558853 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a0241618-9fd5-473b-863e-09e71be81c18 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a874490-179e-412c-895e-52b16935c04c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119145) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:25:39.560571 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-52640635-5253-4302-82a4-b0e364b3e739 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1222 microversion: 2.1 time: 0.098556 Oct 24 13:25:39.561331 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 25/44] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:39 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:39.791328 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a0241618-9fd5-473b-863e-09e71be81c18 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.547267 Oct 24 13:25:39.792570 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 20/45] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 24 13:25:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 1550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 13:25:39.803888 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-752b0761-cddf-4f23-91c6-5b8f8e363d86 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:39.807817 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-752b0761-cddf-4f23-91c6-5b8f8e363d86 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:39.883703 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-752b0761-cddf-4f23-91c6-5b8f8e363d86 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:39.892449 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-752b0761-cddf-4f23-91c6-5b8f8e363d86 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1237 microversion: 2.1 time: 0.092749 Oct 24 13:25:39.893056 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 26/46] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:39 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1237 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:39.931924 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9c85cdb4-c243-4c9f-b3af-4f6ef9d8a617 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:39.931924 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9c85cdb4-c243-4c9f-b3af-4f6ef9d8a617 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:39.936165 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9c85cdb4-c243-4c9f-b3af-4f6ef9d8a617 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:39.936727 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9c85cdb4-c243-4c9f-b3af-4f6ef9d8a617 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:39.937314 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9c85cdb4-c243-4c9f-b3af-4f6ef9d8a617 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:39.937991 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9c85cdb4-c243-4c9f-b3af-4f6ef9d8a617 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:39.938428 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9c85cdb4-c243-4c9f-b3af-4f6ef9d8a617 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:39.938864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9c85cdb4-c243-4c9f-b3af-4f6ef9d8a617 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:40.227250 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9c85cdb4-c243-4c9f-b3af-4f6ef9d8a617 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:40.262272 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9c85cdb4-c243-4c9f-b3af-4f6ef9d8a617 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1284 microversion: 2.1 time: 0.339201 Oct 24 13:25:40.263479 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 21/47] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:39 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1284 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:40.450210 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-298f83cd-3f7a-46c4-9d83-58ffdbf51b32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:40.450832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-298f83cd-3f7a-46c4-9d83-58ffdbf51b32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:40.463740 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-298f83cd-3f7a-46c4-9d83-58ffdbf51b32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:40.464675 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-298f83cd-3f7a-46c4-9d83-58ffdbf51b32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:40.468575 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-298f83cd-3f7a-46c4-9d83-58ffdbf51b32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:40.469173 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-298f83cd-3f7a-46c4-9d83-58ffdbf51b32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:40.469745 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-298f83cd-3f7a-46c4-9d83-58ffdbf51b32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:40.470191 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-298f83cd-3f7a-46c4-9d83-58ffdbf51b32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:40.589275 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-298f83cd-3f7a-46c4-9d83-58ffdbf51b32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:40.594337 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-53eb93e9-db41-4b14-b7c1-e3b4578d75c1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:40.594987 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-53eb93e9-db41-4b14-b7c1-e3b4578d75c1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:40.623342 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-298f83cd-3f7a-46c4-9d83-58ffdbf51b32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:40.631250 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-53eb93e9-db41-4b14-b7c1-e3b4578d75c1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:40.634799 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-298f83cd-3f7a-46c4-9d83-58ffdbf51b32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:40.636167 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-53eb93e9-db41-4b14-b7c1-e3b4578d75c1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:40.642098 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-53eb93e9-db41-4b14-b7c1-e3b4578d75c1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:40.646017 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-53eb93e9-db41-4b14-b7c1-e3b4578d75c1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:40.646523 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-53eb93e9-db41-4b14-b7c1-e3b4578d75c1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:40.647050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-298f83cd-3f7a-46c4-9d83-58ffdbf51b32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1275 microversion: 2.20 time: 0.197764 Oct 24 13:25:40.647563 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 27/48] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:25:40 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1275 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:25:40.663341 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-53eb93e9-db41-4b14-b7c1-e3b4578d75c1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:40.917456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7ec9d4d5-97db-41bb-9d50-5cfc17e8a7f7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:40.918316 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7ec9d4d5-97db-41bb-9d50-5cfc17e8a7f7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:40.933942 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-53eb93e9-db41-4b14-b7c1-e3b4578d75c1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:40.950870 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-53eb93e9-db41-4b14-b7c1-e3b4578d75c1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1218 microversion: 2.1 time: 0.370829 Oct 24 13:25:40.951443 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 22/49] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:40 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1218 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:41.288516 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-2cf4e8c9-79a2-408d-98b8-35d36640f5e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:41.289164 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-2cf4e8c9-79a2-408d-98b8-35d36640f5e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:41.299642 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2cf4e8c9-79a2-408d-98b8-35d36640f5e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:41.299890 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7ec9d4d5-97db-41bb-9d50-5cfc17e8a7f7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:41.300129 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2cf4e8c9-79a2-408d-98b8-35d36640f5e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:41.300734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2cf4e8c9-79a2-408d-98b8-35d36640f5e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:41.304055 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2cf4e8c9-79a2-408d-98b8-35d36640f5e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:41.312684 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7ec9d4d5-97db-41bb-9d50-5cfc17e8a7f7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1237 microversion: 2.1 time: 0.396618 Oct 24 13:25:41.312816 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2cf4e8c9-79a2-408d-98b8-35d36640f5e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:41.312816 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2cf4e8c9-79a2-408d-98b8-35d36640f5e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:41.313218 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 28/50] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:40 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1237 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:25:41.679015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ea39d83f-cda8-4ecb-82ed-f00a86305f3a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:41.683383 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-ea39d83f-cda8-4ecb-82ed-f00a86305f3a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:41.702986 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ea39d83f-cda8-4ecb-82ed-f00a86305f3a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:41.715132 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ea39d83f-cda8-4ecb-82ed-f00a86305f3a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:41.715699 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ea39d83f-cda8-4ecb-82ed-f00a86305f3a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:41.724570 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ea39d83f-cda8-4ecb-82ed-f00a86305f3a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:41.732158 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ea39d83f-cda8-4ecb-82ed-f00a86305f3a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:41.734493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ea39d83f-cda8-4ecb-82ed-f00a86305f3a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:41.926154 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ea39d83f-cda8-4ecb-82ed-f00a86305f3a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:41.966640 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ea39d83f-cda8-4ecb-82ed-f00a86305f3a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:41.980431 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ea39d83f-cda8-4ecb-82ed-f00a86305f3a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:41.990518 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-ea39d83f-cda8-4ecb-82ed-f00a86305f3a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1339 microversion: 2.20 time: 0.308057 Oct 24 13:25:41.992227 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 29/51] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:25:41 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1339 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:25:42.015210 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3339eca4-7e99-4452-90be-5d74c20ef24c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:42.015942 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-3339eca4-7e99-4452-90be-5d74c20ef24c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:42.043376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3339eca4-7e99-4452-90be-5d74c20ef24c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:42.047176 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3339eca4-7e99-4452-90be-5d74c20ef24c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:42.049408 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3339eca4-7e99-4452-90be-5d74c20ef24c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:42.052863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3339eca4-7e99-4452-90be-5d74c20ef24c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:42.053771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3339eca4-7e99-4452-90be-5d74c20ef24c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:42.056015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3339eca4-7e99-4452-90be-5d74c20ef24c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:42.182208 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-2cf4e8c9-79a2-408d-98b8-35d36640f5e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:42.195250 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-2cf4e8c9-79a2-408d-98b8-35d36640f5e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.910530 Oct 24 13:25:42.195837 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 23/52] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:41 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:42.340217 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-22ace309-1e18-4778-a052-53ed717514c7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:42.340839 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-22ace309-1e18-4778-a052-53ed717514c7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:42.365009 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-22ace309-1e18-4778-a052-53ed717514c7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:42.365494 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-22ace309-1e18-4778-a052-53ed717514c7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:42.365925 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-22ace309-1e18-4778-a052-53ed717514c7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:42.372788 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-22ace309-1e18-4778-a052-53ed717514c7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:42.387545 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-22ace309-1e18-4778-a052-53ed717514c7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:42.388114 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-22ace309-1e18-4778-a052-53ed717514c7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:42.830043 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-22ace309-1e18-4778-a052-53ed717514c7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:42.842437 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-22ace309-1e18-4778-a052-53ed717514c7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1233 microversion: 2.1 time: 0.508274 Oct 24 13:25:42.846437 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 24/53] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:42 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1233 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:25:43.027153 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-d2618157-3074-401a-8e6e-cc301239e938 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:43.028397 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-d2618157-3074-401a-8e6e-cc301239e938 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:43.035392 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d2618157-3074-401a-8e6e-cc301239e938 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:43.036366 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d2618157-3074-401a-8e6e-cc301239e938 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:43.037041 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d2618157-3074-401a-8e6e-cc301239e938 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:43.037949 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d2618157-3074-401a-8e6e-cc301239e938 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:43.054086 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d2618157-3074-401a-8e6e-cc301239e938 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:43.054949 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d2618157-3074-401a-8e6e-cc301239e938 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:43.250117 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3339eca4-7e99-4452-90be-5d74c20ef24c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:43.289571 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3339eca4-7e99-4452-90be-5d74c20ef24c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1274 microversion: 2.1 time: 1.295532 Oct 24 13:25:43.319108 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 30/54] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:41 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1274 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:43.327950 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-d98eefeb-c1af-4628-8649-05b727259482 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:43.346932 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-d98eefeb-c1af-4628-8649-05b727259482 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:43.379471 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d98eefeb-c1af-4628-8649-05b727259482 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:43.382173 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d98eefeb-c1af-4628-8649-05b727259482 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:43.382673 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d98eefeb-c1af-4628-8649-05b727259482 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:43.383420 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d98eefeb-c1af-4628-8649-05b727259482 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:43.383905 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d98eefeb-c1af-4628-8649-05b727259482 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:43.391527 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d98eefeb-c1af-4628-8649-05b727259482 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:43.825252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-d2618157-3074-401a-8e6e-cc301239e938 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:43.840358 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-d2618157-3074-401a-8e6e-cc301239e938 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:43.842146 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-d2618157-3074-401a-8e6e-cc301239e938 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:43.846881 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-d2618157-3074-401a-8e6e-cc301239e938 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1337 microversion: 2.20 time: 0.829669 Oct 24 13:25:43.850187 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 25/55] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:25:43 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1337 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:25:43.916615 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c5163e5d-4c8b-4e7a-92ac-1b0bfb01d995 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:43.916615 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-c5163e5d-4c8b-4e7a-92ac-1b0bfb01d995 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:43.935921 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c5163e5d-4c8b-4e7a-92ac-1b0bfb01d995 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:43.949105 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c5163e5d-4c8b-4e7a-92ac-1b0bfb01d995 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:43.949552 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c5163e5d-4c8b-4e7a-92ac-1b0bfb01d995 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:43.950287 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c5163e5d-4c8b-4e7a-92ac-1b0bfb01d995 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:43.950772 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c5163e5d-4c8b-4e7a-92ac-1b0bfb01d995 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:43.954032 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c5163e5d-4c8b-4e7a-92ac-1b0bfb01d995 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:44.345783 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-d98eefeb-c1af-4628-8649-05b727259482 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:44.345783 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-d98eefeb-c1af-4628-8649-05b727259482 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 1.003150 Oct 24 13:25:44.345783 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 31/56] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:43 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:44.345783 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-924d734f-d664-46ac-be4a-e5ce4f2be364 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:44.348744 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-924d734f-d664-46ac-be4a-e5ce4f2be364 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:44.378482 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c5163e5d-4c8b-4e7a-92ac-1b0bfb01d995 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:44.396483 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-c5163e5d-4c8b-4e7a-92ac-1b0bfb01d995 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1289 microversion: 2.1 time: 0.512680 Oct 24 13:25:44.398797 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-924d734f-d664-46ac-be4a-e5ce4f2be364 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:44.399153 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 26/57] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:43 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1289 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:44.401156 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-924d734f-d664-46ac-be4a-e5ce4f2be364 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:44.401697 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-924d734f-d664-46ac-be4a-e5ce4f2be364 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:44.402519 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-924d734f-d664-46ac-be4a-e5ce4f2be364 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:44.403129 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-924d734f-d664-46ac-be4a-e5ce4f2be364 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:44.403765 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-924d734f-d664-46ac-be4a-e5ce4f2be364 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:44.879773 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-924d734f-d664-46ac-be4a-e5ce4f2be364 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:44.884795 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b6f3fbc9-0fdb-45f5-b27f-c7cd2c151f49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:44.886189 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b6f3fbc9-0fdb-45f5-b27f-c7cd2c151f49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:44.903005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-924d734f-d664-46ac-be4a-e5ce4f2be364 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1280 microversion: 2.1 time: 0.574196 Oct 24 13:25:44.905564 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6f3fbc9-0fdb-45f5-b27f-c7cd2c151f49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:44.916367 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6f3fbc9-0fdb-45f5-b27f-c7cd2c151f49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:44.916367 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6f3fbc9-0fdb-45f5-b27f-c7cd2c151f49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:44.917060 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6f3fbc9-0fdb-45f5-b27f-c7cd2c151f49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:44.926065 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6f3fbc9-0fdb-45f5-b27f-c7cd2c151f49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:44.926065 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6f3fbc9-0fdb-45f5-b27f-c7cd2c151f49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:44.926525 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 32/58] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:44 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1280 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:45.128330 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b6f3fbc9-0fdb-45f5-b27f-c7cd2c151f49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:45.144205 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b6f3fbc9-0fdb-45f5-b27f-c7cd2c151f49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:45.151802 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b6f3fbc9-0fdb-45f5-b27f-c7cd2c151f49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:45.153808 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b6f3fbc9-0fdb-45f5-b27f-c7cd2c151f49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1337 microversion: 2.20 time: 0.280222 Oct 24 13:25:45.154612 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 27/59] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:25:44 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1337 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:25:45.371156 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c112c19e-7e40-4bda-a71d-6d893d50f87f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:45.371879 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c112c19e-7e40-4bda-a71d-6d893d50f87f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:45.392785 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c112c19e-7e40-4bda-a71d-6d893d50f87f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:45.396153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c112c19e-7e40-4bda-a71d-6d893d50f87f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:45.399460 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c112c19e-7e40-4bda-a71d-6d893d50f87f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:45.404036 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c112c19e-7e40-4bda-a71d-6d893d50f87f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:45.404759 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c112c19e-7e40-4bda-a71d-6d893d50f87f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:45.405403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c112c19e-7e40-4bda-a71d-6d893d50f87f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:45.423956 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b5b53b99-6fed-4379-b1e1-73b0912b8796 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:45.424382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b5b53b99-6fed-4379-b1e1-73b0912b8796 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:45.440440 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b5b53b99-6fed-4379-b1e1-73b0912b8796 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:45.441630 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b5b53b99-6fed-4379-b1e1-73b0912b8796 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:45.442961 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b5b53b99-6fed-4379-b1e1-73b0912b8796 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:45.448906 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b5b53b99-6fed-4379-b1e1-73b0912b8796 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:45.451343 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b5b53b99-6fed-4379-b1e1-73b0912b8796 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:45.452916 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b5b53b99-6fed-4379-b1e1-73b0912b8796 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:45.792924 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b5b53b99-6fed-4379-b1e1-73b0912b8796 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:45.830291 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b5b53b99-6fed-4379-b1e1-73b0912b8796 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1307 microversion: 2.1 time: 0.410599 Oct 24 13:25:45.852460 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 28/60] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:45 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1307 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:45.934070 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-fb37a40a-58e8-48ab-a76c-048b1e0721b5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:45.935378 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-fb37a40a-58e8-48ab-a76c-048b1e0721b5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:45.954402 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb37a40a-58e8-48ab-a76c-048b1e0721b5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:45.955016 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb37a40a-58e8-48ab-a76c-048b1e0721b5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:45.955461 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb37a40a-58e8-48ab-a76c-048b1e0721b5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:45.956184 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb37a40a-58e8-48ab-a76c-048b1e0721b5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:45.956974 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb37a40a-58e8-48ab-a76c-048b1e0721b5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:45.959460 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb37a40a-58e8-48ab-a76c-048b1e0721b5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:46.116553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c112c19e-7e40-4bda-a71d-6d893d50f87f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:46.126025 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c112c19e-7e40-4bda-a71d-6d893d50f87f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.760695 Oct 24 13:25:46.128396 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 33/61] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:45 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:46.184630 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-13f4d42f-45c2-4cdc-985c-5eb091716e7d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:46.186194 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-13f4d42f-45c2-4cdc-985c-5eb091716e7d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:46.201418 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-13f4d42f-45c2-4cdc-985c-5eb091716e7d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:46.202095 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-13f4d42f-45c2-4cdc-985c-5eb091716e7d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:46.202664 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-13f4d42f-45c2-4cdc-985c-5eb091716e7d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:46.203513 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-13f4d42f-45c2-4cdc-985c-5eb091716e7d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:46.208499 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-13f4d42f-45c2-4cdc-985c-5eb091716e7d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:46.209138 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-13f4d42f-45c2-4cdc-985c-5eb091716e7d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:46.401505 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-fb37a40a-58e8-48ab-a76c-048b1e0721b5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:46.419482 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-fb37a40a-58e8-48ab-a76c-048b1e0721b5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1280 microversion: 2.1 time: 0.487585 Oct 24 13:25:46.436549 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 29/62] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:45 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1280 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:46.488777 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-13f4d42f-45c2-4cdc-985c-5eb091716e7d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:46.530750 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-13f4d42f-45c2-4cdc-985c-5eb091716e7d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:46.534353 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-13f4d42f-45c2-4cdc-985c-5eb091716e7d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:46.537539 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-13f4d42f-45c2-4cdc-985c-5eb091716e7d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1337 microversion: 2.20 time: 0.356740 Oct 24 13:25:46.541707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 34/63] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:25:46 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1337 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:25:46.854121 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-1f3b67a2-c0f8-4c4e-99cc-2eb15e755445 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:46.854733 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-1f3b67a2-c0f8-4c4e-99cc-2eb15e755445 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:46.863939 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1f3b67a2-c0f8-4c4e-99cc-2eb15e755445 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:46.864464 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1f3b67a2-c0f8-4c4e-99cc-2eb15e755445 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:46.864891 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1f3b67a2-c0f8-4c4e-99cc-2eb15e755445 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:46.865576 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1f3b67a2-c0f8-4c4e-99cc-2eb15e755445 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:46.866009 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1f3b67a2-c0f8-4c4e-99cc-2eb15e755445 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:46.875864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1f3b67a2-c0f8-4c4e-99cc-2eb15e755445 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:47.154912 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f94df2bb-444e-4ed5-b40f-a71ed11b03ba tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:47.155806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f94df2bb-444e-4ed5-b40f-a71ed11b03ba tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:47.171541 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f94df2bb-444e-4ed5-b40f-a71ed11b03ba tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:47.172056 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f94df2bb-444e-4ed5-b40f-a71ed11b03ba tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:47.172535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f94df2bb-444e-4ed5-b40f-a71ed11b03ba tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:47.173982 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f94df2bb-444e-4ed5-b40f-a71ed11b03ba tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:47.174457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f94df2bb-444e-4ed5-b40f-a71ed11b03ba tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:47.176284 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f94df2bb-444e-4ed5-b40f-a71ed11b03ba tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:47.642295 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1f3b67a2-c0f8-4c4e-99cc-2eb15e755445 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:47.661172 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-1f3b67a2-c0f8-4c4e-99cc-2eb15e755445 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1295 microversion: 2.1 time: 0.811691 Oct 24 13:25:47.684375 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 30/64] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:46 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1295 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:47.701128 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-50fb6588-e29d-464b-b4be-7929eb266cbd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:47.701735 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-50fb6588-e29d-464b-b4be-7929eb266cbd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:47.728973 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-50fb6588-e29d-464b-b4be-7929eb266cbd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:47.730263 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-50fb6588-e29d-464b-b4be-7929eb266cbd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:47.730852 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-50fb6588-e29d-464b-b4be-7929eb266cbd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:47.731711 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-50fb6588-e29d-464b-b4be-7929eb266cbd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:47.732349 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-50fb6588-e29d-464b-b4be-7929eb266cbd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:47.732919 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-50fb6588-e29d-464b-b4be-7929eb266cbd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:47.987721 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=6 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:48.039965 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f94df2bb-444e-4ed5-b40f-a71ed11b03ba tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:48.060313 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f94df2bb-444e-4ed5-b40f-a71ed11b03ba tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.908491 Oct 24 13:25:48.065120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 35/65] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:47 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:25:48.073344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e5a3a4f7-f170-4145-ac03-dc7d3dce0137 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:48.073954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e5a3a4f7-f170-4145-ac03-dc7d3dce0137 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:48.092368 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:48.094163 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e5a3a4f7-f170-4145-ac03-dc7d3dce0137 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:48.094968 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e5a3a4f7-f170-4145-ac03-dc7d3dce0137 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:48.096129 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e5a3a4f7-f170-4145-ac03-dc7d3dce0137 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:48.097092 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e5a3a4f7-f170-4145-ac03-dc7d3dce0137 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:48.105438 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e5a3a4f7-f170-4145-ac03-dc7d3dce0137 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:48.106168 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e5a3a4f7-f170-4145-ac03-dc7d3dce0137 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:48.144940 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-50fb6588-e29d-464b-b4be-7929eb266cbd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:48.155565 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-50fb6588-e29d-464b-b4be-7929eb266cbd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1280 microversion: 2.1 time: 0.470049 Oct 24 13:25:48.162126 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 31/66] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:47 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1280 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:48.314757 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-7da7a583-102f-4e04-b9f3-6a3ff09d1ae0 req-fc56a665-5f6f-4873-b0a3-a8f93ffddf37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a9564e-c320-4bad-bcfc-8332aec8c690", "tag": "88cc8087-11c0-4a7a-b07d-0fa49eefb5f0"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:25:48.332468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-7da7a583-102f-4e04-b9f3-6a3ff09d1ae0 req-fc56a665-5f6f-4873-b0a3-a8f93ffddf37 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:48.332468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-7da7a583-102f-4e04-b9f3-6a3ff09d1ae0 req-fc56a665-5f6f-4873-b0a3-a8f93ffddf37 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:48.334894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-7da7a583-102f-4e04-b9f3-6a3ff09d1ae0 req-fc56a665-5f6f-4873-b0a3-a8f93ffddf37 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:48.362742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-7da7a583-102f-4e04-b9f3-6a3ff09d1ae0 req-fc56a665-5f6f-4873-b0a3-a8f93ffddf37 service nova] Creating event network-changed:88cc8087-11c0-4a7a-b07d-0fa49eefb5f0 for instance 13a9564e-c320-4bad-bcfc-8332aec8c690 on hv-cinder-86249 Oct 24 13:25:48.363464 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-7da7a583-102f-4e04-b9f3-6a3ff09d1ae0 req-fc56a665-5f6f-4873-b0a3-a8f93ffddf37 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119145) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 13:25:48.364186 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-7da7a583-102f-4e04-b9f3-6a3ff09d1ae0 req-fc56a665-5f6f-4873-b0a3-a8f93ffddf37 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119145) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 13:25:48.366396 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-46f446df-f696-42f1-909d-53c4e65cd2d1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:48.368183 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-46f446df-f696-42f1-909d-53c4e65cd2d1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:48.368801 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-46f446df-f696-42f1-909d-53c4e65cd2d1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:48.369702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-46f446df-f696-42f1-909d-53c4e65cd2d1 None None] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:48.370434 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-46f446df-f696-42f1-909d-53c4e65cd2d1 None None] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:48.371126 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-46f446df-f696-42f1-909d-53c4e65cd2d1 None None] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:48.386771 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.compute.rpcapi [None req-46f446df-f696-42f1-909d-53c4e65cd2d1 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 24 13:25:48.389156 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-46f446df-f696-42f1-909d-53c4e65cd2d1 None None] Releasing lock "compute-rpcapi-router" {{(pid=119145) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 13:25:48.409300 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-46f446df-f696-42f1-909d-53c4e65cd2d1 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.234386 Oct 24 13:25:48.410477 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 32/67] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:25:48.571265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-8986d524-67e9-4f68-adaa-ca3a32b825ee req-592b916d-f4a0-4e94-8ef8-9aa8597aba6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48b2c12f-1e60-4000-ac5c-d7a5864939a1", "tag": "cf65c088-1188-479e-a207-5b5919c77b82"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:25:48.596168 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-8986d524-67e9-4f68-adaa-ca3a32b825ee req-592b916d-f4a0-4e94-8ef8-9aa8597aba6c service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:48.597944 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-8986d524-67e9-4f68-adaa-ca3a32b825ee req-592b916d-f4a0-4e94-8ef8-9aa8597aba6c service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:48.599121 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-8986d524-67e9-4f68-adaa-ca3a32b825ee req-592b916d-f4a0-4e94-8ef8-9aa8597aba6c service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:48.638625 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-8986d524-67e9-4f68-adaa-ca3a32b825ee req-592b916d-f4a0-4e94-8ef8-9aa8597aba6c service nova] Creating event network-changed:cf65c088-1188-479e-a207-5b5919c77b82 for instance 48b2c12f-1e60-4000-ac5c-d7a5864939a1 on hv-cinder-86249 Oct 24 13:25:48.647127 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-8986d524-67e9-4f68-adaa-ca3a32b825ee req-592b916d-f4a0-4e94-8ef8-9aa8597aba6c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.235094 Oct 24 13:25:48.648080 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 33/68] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:25:48.667788 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e5a3a4f7-f170-4145-ac03-dc7d3dce0137 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:48.677323 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e5a3a4f7-f170-4145-ac03-dc7d3dce0137 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:48.679172 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e5a3a4f7-f170-4145-ac03-dc7d3dce0137 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:48.681063 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e5a3a4f7-f170-4145-ac03-dc7d3dce0137 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.614994 Oct 24 13:25:48.681846 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 36/69] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:25:48 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:25:48.692332 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-5f204865-c0ee-4d02-a570-efe55c18afa1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:48.695082 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-5f204865-c0ee-4d02-a570-efe55c18afa1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:48.699548 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5f204865-c0ee-4d02-a570-efe55c18afa1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:48.700022 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5f204865-c0ee-4d02-a570-efe55c18afa1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:48.700495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5f204865-c0ee-4d02-a570-efe55c18afa1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:48.701371 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5f204865-c0ee-4d02-a570-efe55c18afa1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:48.701956 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5f204865-c0ee-4d02-a570-efe55c18afa1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:48.702513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5f204865-c0ee-4d02-a570-efe55c18afa1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:48.928361 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-5f204865-c0ee-4d02-a570-efe55c18afa1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:48.940288 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-5f204865-c0ee-4d02-a570-efe55c18afa1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1295 microversion: 2.1 time: 0.254231 Oct 24 13:25:48.952328 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 34/70] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:48 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1295 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:49.094670 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b38d070b-dc7e-43f1-8398-2c90d115bf6a tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:49.099893 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b38d070b-dc7e-43f1-8398-2c90d115bf6a tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:49.111651 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b38d070b-dc7e-43f1-8398-2c90d115bf6a tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:49.112452 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b38d070b-dc7e-43f1-8398-2c90d115bf6a tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:49.117597 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b38d070b-dc7e-43f1-8398-2c90d115bf6a tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:49.117597 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b38d070b-dc7e-43f1-8398-2c90d115bf6a tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:49.117597 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b38d070b-dc7e-43f1-8398-2c90d115bf6a tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:49.117597 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b38d070b-dc7e-43f1-8398-2c90d115bf6a tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:49.189209 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-da717de8-295f-4449-97e0-4a99905bb55b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:49.190643 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-da717de8-295f-4449-97e0-4a99905bb55b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:49.198427 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-da717de8-295f-4449-97e0-4a99905bb55b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:49.199118 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-da717de8-295f-4449-97e0-4a99905bb55b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:49.199598 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-da717de8-295f-4449-97e0-4a99905bb55b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:49.200349 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-da717de8-295f-4449-97e0-4a99905bb55b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:49.200933 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-da717de8-295f-4449-97e0-4a99905bb55b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:49.202641 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-da717de8-295f-4449-97e0-4a99905bb55b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:49.293887 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b38d070b-dc7e-43f1-8398-2c90d115bf6a tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:49.295048 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-da717de8-295f-4449-97e0-4a99905bb55b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:49.311839 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b38d070b-dc7e-43f1-8398-2c90d115bf6a tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.220888 Oct 24 13:25:49.322044 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 37/71] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:49 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:49.335454 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-da717de8-295f-4449-97e0-4a99905bb55b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1280 microversion: 2.1 time: 0.150960 Oct 24 13:25:49.338929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 35/72] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:49 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1280 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:25:49.711266 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-115bc851-f65b-40d3-b200-9e789fabbda7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:49.712402 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-115bc851-f65b-40d3-b200-9e789fabbda7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:49.723261 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-115bc851-f65b-40d3-b200-9e789fabbda7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:49.726668 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-115bc851-f65b-40d3-b200-9e789fabbda7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:49.728301 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-115bc851-f65b-40d3-b200-9e789fabbda7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:49.730307 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-115bc851-f65b-40d3-b200-9e789fabbda7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:49.732043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-115bc851-f65b-40d3-b200-9e789fabbda7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:49.733860 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-115bc851-f65b-40d3-b200-9e789fabbda7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:49.905670 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-115bc851-f65b-40d3-b200-9e789fabbda7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:49.914559 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-115bc851-f65b-40d3-b200-9e789fabbda7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:49.916028 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-115bc851-f65b-40d3-b200-9e789fabbda7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:49.917186 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-115bc851-f65b-40d3-b200-9e789fabbda7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.211567 Oct 24 13:25:49.917742 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 38/73] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:25:49 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:25:49.964360 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7a801a70-a7e2-44c8-b5de-2e5f5acbdb54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:49.964978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-7a801a70-a7e2-44c8-b5de-2e5f5acbdb54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:49.966895 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=26 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:49.971781 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7a801a70-a7e2-44c8-b5de-2e5f5acbdb54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:49.974907 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7a801a70-a7e2-44c8-b5de-2e5f5acbdb54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:49.974907 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7a801a70-a7e2-44c8-b5de-2e5f5acbdb54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:49.974907 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7a801a70-a7e2-44c8-b5de-2e5f5acbdb54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:49.974907 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7a801a70-a7e2-44c8-b5de-2e5f5acbdb54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:49.975215 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7a801a70-a7e2-44c8-b5de-2e5f5acbdb54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:50.130208 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-7a801a70-a7e2-44c8-b5de-2e5f5acbdb54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:50.138574 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-7a801a70-a7e2-44c8-b5de-2e5f5acbdb54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.178146 Oct 24 13:25:50.139150 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 36/74] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:49 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:50.338748 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-876b1689-b7ad-4c06-8913-bbe814d4be50 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:50.339359 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-876b1689-b7ad-4c06-8913-bbe814d4be50 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:50.345254 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-876b1689-b7ad-4c06-8913-bbe814d4be50 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:50.345929 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-876b1689-b7ad-4c06-8913-bbe814d4be50 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:50.346353 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-876b1689-b7ad-4c06-8913-bbe814d4be50 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:50.347031 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-876b1689-b7ad-4c06-8913-bbe814d4be50 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:50.347480 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-876b1689-b7ad-4c06-8913-bbe814d4be50 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:50.347972 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-876b1689-b7ad-4c06-8913-bbe814d4be50 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:50.366441 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0c5460e7-f738-4e8a-8e4e-b0865d68c24e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:50.367295 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0c5460e7-f738-4e8a-8e4e-b0865d68c24e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:50.372544 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:50.374970 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0c5460e7-f738-4e8a-8e4e-b0865d68c24e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:50.375774 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0c5460e7-f738-4e8a-8e4e-b0865d68c24e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:50.376457 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0c5460e7-f738-4e8a-8e4e-b0865d68c24e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:50.377344 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0c5460e7-f738-4e8a-8e4e-b0865d68c24e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:50.377966 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0c5460e7-f738-4e8a-8e4e-b0865d68c24e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:50.378580 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0c5460e7-f738-4e8a-8e4e-b0865d68c24e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:50.523459 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-876b1689-b7ad-4c06-8913-bbe814d4be50 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:50.532682 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-876b1689-b7ad-4c06-8913-bbe814d4be50 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.198272 Oct 24 13:25:50.533566 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 39/75] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:50 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:50.534761 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0c5460e7-f738-4e8a-8e4e-b0865d68c24e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:50.538330 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=100 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:50.543120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0c5460e7-f738-4e8a-8e4e-b0865d68c24e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.180952 Oct 24 13:25:50.543685 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 37/76] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:50 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:50.942584 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-fd73adc2-4119-4fbf-a957-7b2a98bdefec tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:50.943171 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-fd73adc2-4119-4fbf-a957-7b2a98bdefec tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:50.948928 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fd73adc2-4119-4fbf-a957-7b2a98bdefec tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:50.949602 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fd73adc2-4119-4fbf-a957-7b2a98bdefec tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:50.950258 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fd73adc2-4119-4fbf-a957-7b2a98bdefec tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:50.950827 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fd73adc2-4119-4fbf-a957-7b2a98bdefec tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:50.951430 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fd73adc2-4119-4fbf-a957-7b2a98bdefec tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:50.951839 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fd73adc2-4119-4fbf-a957-7b2a98bdefec tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:51.089636 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fd73adc2-4119-4fbf-a957-7b2a98bdefec tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:51.099531 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fd73adc2-4119-4fbf-a957-7b2a98bdefec tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:51.101508 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fd73adc2-4119-4fbf-a957-7b2a98bdefec tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:51.102616 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-fd73adc2-4119-4fbf-a957-7b2a98bdefec tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.163953 Oct 24 13:25:51.103180 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 40/77] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:25:50 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:25:51.161580 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e205570f-ee6b-4a05-90de-8890167e1b83 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:51.162225 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e205570f-ee6b-4a05-90de-8890167e1b83 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:51.169924 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e205570f-ee6b-4a05-90de-8890167e1b83 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:51.170576 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e205570f-ee6b-4a05-90de-8890167e1b83 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:51.171217 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e205570f-ee6b-4a05-90de-8890167e1b83 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:51.171895 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e205570f-ee6b-4a05-90de-8890167e1b83 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:51.172537 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e205570f-ee6b-4a05-90de-8890167e1b83 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:51.173144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e205570f-ee6b-4a05-90de-8890167e1b83 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:51.310058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e205570f-ee6b-4a05-90de-8890167e1b83 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:51.317547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e205570f-ee6b-4a05-90de-8890167e1b83 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.159717 Oct 24 13:25:51.318121 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 38/78] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:51 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:51.563101 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-d7db2394-a8cf-4037-b09a-b350e6911328 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:51.563714 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-d7db2394-a8cf-4037-b09a-b350e6911328 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:51.565284 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0455353e-2da6-4ae7-8d31-f816c5b1545b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:51.565882 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0455353e-2da6-4ae7-8d31-f816c5b1545b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:51.567474 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=30 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:51.572296 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0455353e-2da6-4ae7-8d31-f816c5b1545b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:51.572785 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0455353e-2da6-4ae7-8d31-f816c5b1545b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:51.572988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d7db2394-a8cf-4037-b09a-b350e6911328 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:51.573203 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0455353e-2da6-4ae7-8d31-f816c5b1545b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:51.573471 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d7db2394-a8cf-4037-b09a-b350e6911328 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:51.573872 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0455353e-2da6-4ae7-8d31-f816c5b1545b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:51.573964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d7db2394-a8cf-4037-b09a-b350e6911328 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:51.574313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0455353e-2da6-4ae7-8d31-f816c5b1545b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:51.574575 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d7db2394-a8cf-4037-b09a-b350e6911328 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:51.574720 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0455353e-2da6-4ae7-8d31-f816c5b1545b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:51.575024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d7db2394-a8cf-4037-b09a-b350e6911328 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:51.575446 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d7db2394-a8cf-4037-b09a-b350e6911328 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:51.597050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=100 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:51.716771 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0455353e-2da6-4ae7-8d31-f816c5b1545b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:51.721926 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-d7db2394-a8cf-4037-b09a-b350e6911328 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:51.724967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0455353e-2da6-4ae7-8d31-f816c5b1545b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.163520 Oct 24 13:25:51.725625 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 39/79] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:51 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:51.730339 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-d7db2394-a8cf-4037-b09a-b350e6911328 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.171252 Oct 24 13:25:51.730894 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 41/80] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:51 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:52.128619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e19b9d47-75e9-45eb-b8c8-d8d72cde4dd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:52.129442 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e19b9d47-75e9-45eb-b8c8-d8d72cde4dd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:52.136097 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e19b9d47-75e9-45eb-b8c8-d8d72cde4dd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:52.136629 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e19b9d47-75e9-45eb-b8c8-d8d72cde4dd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:52.137051 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e19b9d47-75e9-45eb-b8c8-d8d72cde4dd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:52.137725 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e19b9d47-75e9-45eb-b8c8-d8d72cde4dd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:52.138835 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e19b9d47-75e9-45eb-b8c8-d8d72cde4dd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:52.139322 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e19b9d47-75e9-45eb-b8c8-d8d72cde4dd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:52.307598 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e19b9d47-75e9-45eb-b8c8-d8d72cde4dd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:52.315664 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e19b9d47-75e9-45eb-b8c8-d8d72cde4dd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:52.317134 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e19b9d47-75e9-45eb-b8c8-d8d72cde4dd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:52.318238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e19b9d47-75e9-45eb-b8c8-d8d72cde4dd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.193760 Oct 24 13:25:52.318966 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 40/81] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:25:52 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:25:52.342059 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-0510a53c-b741-4e31-9142-3240753e0b78 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:52.342658 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-0510a53c-b741-4e31-9142-3240753e0b78 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:52.349343 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0510a53c-b741-4e31-9142-3240753e0b78 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:52.349812 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0510a53c-b741-4e31-9142-3240753e0b78 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:52.350231 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0510a53c-b741-4e31-9142-3240753e0b78 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:52.351425 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0510a53c-b741-4e31-9142-3240753e0b78 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:52.351870 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0510a53c-b741-4e31-9142-3240753e0b78 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:52.352290 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0510a53c-b741-4e31-9142-3240753e0b78 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:52.532789 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-0510a53c-b741-4e31-9142-3240753e0b78 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:52.549058 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-0510a53c-b741-4e31-9142-3240753e0b78 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.211758 Oct 24 13:25:52.549856 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 42/82] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:52 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:52.756633 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-68cf6d4a-a94a-4487-812f-1d1c1bd1b75b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:52.758514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-629b7e55-ccf5-4c96-a374-569fb29f7617 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:52.759399 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-629b7e55-ccf5-4c96-a374-569fb29f7617 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:52.760234 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-68cf6d4a-a94a-4487-812f-1d1c1bd1b75b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:52.774105 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-629b7e55-ccf5-4c96-a374-569fb29f7617 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:52.778695 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-629b7e55-ccf5-4c96-a374-569fb29f7617 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:52.779497 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-68cf6d4a-a94a-4487-812f-1d1c1bd1b75b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:52.781654 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-68cf6d4a-a94a-4487-812f-1d1c1bd1b75b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:52.782142 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-629b7e55-ccf5-4c96-a374-569fb29f7617 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:52.786342 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-629b7e55-ccf5-4c96-a374-569fb29f7617 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:52.786342 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-629b7e55-ccf5-4c96-a374-569fb29f7617 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:52.786342 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-629b7e55-ccf5-4c96-a374-569fb29f7617 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:52.786692 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-68cf6d4a-a94a-4487-812f-1d1c1bd1b75b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:52.786692 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-68cf6d4a-a94a-4487-812f-1d1c1bd1b75b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:52.786692 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-68cf6d4a-a94a-4487-812f-1d1c1bd1b75b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:52.788424 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-68cf6d4a-a94a-4487-812f-1d1c1bd1b75b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:53.033676 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-68cf6d4a-a94a-4487-812f-1d1c1bd1b75b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:53.042523 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-68cf6d4a-a94a-4487-812f-1d1c1bd1b75b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.290046 Oct 24 13:25:53.046585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-629b7e55-ccf5-4c96-a374-569fb29f7617 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:53.046770 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 43/83] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:52 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:25:53.067541 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-629b7e55-ccf5-4c96-a374-569fb29f7617 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.321621 Oct 24 13:25:53.070985 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 41/84] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:52 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:53.344861 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b664eac6-abdd-4a92-866e-7b8ad2072964 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:53.357502 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b664eac6-abdd-4a92-866e-7b8ad2072964 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:53.357502 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b664eac6-abdd-4a92-866e-7b8ad2072964 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:53.357502 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b664eac6-abdd-4a92-866e-7b8ad2072964 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:53.357502 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b664eac6-abdd-4a92-866e-7b8ad2072964 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:53.357899 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b664eac6-abdd-4a92-866e-7b8ad2072964 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:53.357899 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b664eac6-abdd-4a92-866e-7b8ad2072964 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:53.357899 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b664eac6-abdd-4a92-866e-7b8ad2072964 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:53.497266 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b664eac6-abdd-4a92-866e-7b8ad2072964 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:53.506247 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b664eac6-abdd-4a92-866e-7b8ad2072964 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:53.507618 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b664eac6-abdd-4a92-866e-7b8ad2072964 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:53.508957 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b664eac6-abdd-4a92-866e-7b8ad2072964 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.168093 Oct 24 13:25:53.509510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 44/85] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:25:53 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:25:53.575604 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c454c621-82c9-4c4d-9da2-5d8e2b9cfd49 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:53.576979 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-c454c621-82c9-4c4d-9da2-5d8e2b9cfd49 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:53.591924 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c454c621-82c9-4c4d-9da2-5d8e2b9cfd49 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:53.598540 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c454c621-82c9-4c4d-9da2-5d8e2b9cfd49 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:53.599271 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c454c621-82c9-4c4d-9da2-5d8e2b9cfd49 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:53.600202 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c454c621-82c9-4c4d-9da2-5d8e2b9cfd49 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:53.601778 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c454c621-82c9-4c4d-9da2-5d8e2b9cfd49 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:53.603344 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c454c621-82c9-4c4d-9da2-5d8e2b9cfd49 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:53.758905 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c454c621-82c9-4c4d-9da2-5d8e2b9cfd49 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:53.768000 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-c454c621-82c9-4c4d-9da2-5d8e2b9cfd49 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.197109 Oct 24 13:25:53.768833 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 42/86] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:53 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:54.075926 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-6f58c4b8-0500-439b-8af4-9c41d7fc49b6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:54.075926 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-6f58c4b8-0500-439b-8af4-9c41d7fc49b6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:54.080927 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6f58c4b8-0500-439b-8af4-9c41d7fc49b6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:54.081679 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6f58c4b8-0500-439b-8af4-9c41d7fc49b6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:54.082110 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6f58c4b8-0500-439b-8af4-9c41d7fc49b6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:54.082806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6f58c4b8-0500-439b-8af4-9c41d7fc49b6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:54.083257 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6f58c4b8-0500-439b-8af4-9c41d7fc49b6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:54.083677 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6f58c4b8-0500-439b-8af4-9c41d7fc49b6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:54.104308 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-09aafbae-0990-44c7-83b8-3bcd93063452 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:54.106988 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-09aafbae-0990-44c7-83b8-3bcd93063452 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:54.114108 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-09aafbae-0990-44c7-83b8-3bcd93063452 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:54.115030 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-09aafbae-0990-44c7-83b8-3bcd93063452 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:54.115841 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-09aafbae-0990-44c7-83b8-3bcd93063452 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:54.117099 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-09aafbae-0990-44c7-83b8-3bcd93063452 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:54.118533 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-09aafbae-0990-44c7-83b8-3bcd93063452 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:54.119260 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-09aafbae-0990-44c7-83b8-3bcd93063452 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:54.298571 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6f58c4b8-0500-439b-8af4-9c41d7fc49b6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:54.308821 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-6f58c4b8-0500-439b-8af4-9c41d7fc49b6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.239043 Oct 24 13:25:54.309659 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 45/87] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:54 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:54.343470 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-09aafbae-0990-44c7-83b8-3bcd93063452 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:54.353427 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-09aafbae-0990-44c7-83b8-3bcd93063452 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.253633 Oct 24 13:25:54.354502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 43/88] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:54 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:25:54.534312 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-fac0dbf9-800e-48fb-877e-1a6dfcedfff1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:54.535052 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-fac0dbf9-800e-48fb-877e-1a6dfcedfff1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:54.542676 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fac0dbf9-800e-48fb-877e-1a6dfcedfff1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:54.547400 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fac0dbf9-800e-48fb-877e-1a6dfcedfff1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:54.547400 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fac0dbf9-800e-48fb-877e-1a6dfcedfff1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:54.547400 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fac0dbf9-800e-48fb-877e-1a6dfcedfff1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:54.547400 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fac0dbf9-800e-48fb-877e-1a6dfcedfff1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:54.547904 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fac0dbf9-800e-48fb-877e-1a6dfcedfff1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:54.750010 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fac0dbf9-800e-48fb-877e-1a6dfcedfff1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:54.760935 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fac0dbf9-800e-48fb-877e-1a6dfcedfff1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:54.762417 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fac0dbf9-800e-48fb-877e-1a6dfcedfff1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:54.763843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-fac0dbf9-800e-48fb-877e-1a6dfcedfff1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.233335 Oct 24 13:25:54.764830 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 46/89] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:25:54 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:25:54.794333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-1ffc15ad-31aa-4323-a1e8-845f9918cf5d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:54.795903 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-1ffc15ad-31aa-4323-a1e8-845f9918cf5d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:54.809925 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ffc15ad-31aa-4323-a1e8-845f9918cf5d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:54.814793 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ffc15ad-31aa-4323-a1e8-845f9918cf5d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:54.814793 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ffc15ad-31aa-4323-a1e8-845f9918cf5d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:54.814793 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ffc15ad-31aa-4323-a1e8-845f9918cf5d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:54.814793 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ffc15ad-31aa-4323-a1e8-845f9918cf5d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:54.815110 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ffc15ad-31aa-4323-a1e8-845f9918cf5d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:55.011270 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1ffc15ad-31aa-4323-a1e8-845f9918cf5d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:55.021221 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-1ffc15ad-31aa-4323-a1e8-845f9918cf5d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.230591 Oct 24 13:25:55.025949 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 44/90] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:54 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:55.334264 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5d76f4f1-fae6-4a00-9b04-848da946960a tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:55.335049 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5d76f4f1-fae6-4a00-9b04-848da946960a tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:55.341819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5d76f4f1-fae6-4a00-9b04-848da946960a tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:55.342540 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5d76f4f1-fae6-4a00-9b04-848da946960a tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:55.342971 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5d76f4f1-fae6-4a00-9b04-848da946960a tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:55.343653 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5d76f4f1-fae6-4a00-9b04-848da946960a tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:55.344153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5d76f4f1-fae6-4a00-9b04-848da946960a tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:55.344645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5d76f4f1-fae6-4a00-9b04-848da946960a tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:55.391353 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-4de635c5-039c-4f4c-a4b0-88cf011b5924 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:55.392071 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-4de635c5-039c-4f4c-a4b0-88cf011b5924 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:55.409144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4de635c5-039c-4f4c-a4b0-88cf011b5924 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:55.409144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4de635c5-039c-4f4c-a4b0-88cf011b5924 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:55.409144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4de635c5-039c-4f4c-a4b0-88cf011b5924 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:55.409144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4de635c5-039c-4f4c-a4b0-88cf011b5924 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:55.409707 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4de635c5-039c-4f4c-a4b0-88cf011b5924 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:55.409707 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4de635c5-039c-4f4c-a4b0-88cf011b5924 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:55.571867 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5d76f4f1-fae6-4a00-9b04-848da946960a tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:55.581673 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5d76f4f1-fae6-4a00-9b04-848da946960a tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.250619 Oct 24 13:25:55.583407 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 47/91] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:55 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:25:55.606042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-4de635c5-039c-4f4c-a4b0-88cf011b5924 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:55.628827 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-4de635c5-039c-4f4c-a4b0-88cf011b5924 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.245971 Oct 24 13:25:55.628827 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 45/92] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:55 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:25:55.808611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9f777669-a61d-4f85-b63e-e766dc8f683b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:55.809546 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-9f777669-a61d-4f85-b63e-e766dc8f683b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:55.819029 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f777669-a61d-4f85-b63e-e766dc8f683b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:55.819706 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f777669-a61d-4f85-b63e-e766dc8f683b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:55.820321 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f777669-a61d-4f85-b63e-e766dc8f683b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:55.821366 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f777669-a61d-4f85-b63e-e766dc8f683b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:55.821966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f777669-a61d-4f85-b63e-e766dc8f683b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:55.822556 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f777669-a61d-4f85-b63e-e766dc8f683b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:55.978747 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-9f777669-a61d-4f85-b63e-e766dc8f683b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:55.981269 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-9f777669-a61d-4f85-b63e-e766dc8f683b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:55.982712 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-9f777669-a61d-4f85-b63e-e766dc8f683b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:55.983853 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9f777669-a61d-4f85-b63e-e766dc8f683b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.190566 Oct 24 13:25:55.984462 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 48/93] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:25:55 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:25:56.045612 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b898e306-a329-4183-8447-305ebe7d027c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:56.051924 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b898e306-a329-4183-8447-305ebe7d027c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:56.058528 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b898e306-a329-4183-8447-305ebe7d027c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:56.059030 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b898e306-a329-4183-8447-305ebe7d027c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:56.059455 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b898e306-a329-4183-8447-305ebe7d027c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:56.060143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b898e306-a329-4183-8447-305ebe7d027c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:56.060609 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b898e306-a329-4183-8447-305ebe7d027c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:56.061021 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b898e306-a329-4183-8447-305ebe7d027c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:56.233850 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b898e306-a329-4183-8447-305ebe7d027c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:56.242574 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b898e306-a329-4183-8447-305ebe7d027c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.200675 Oct 24 13:25:56.243206 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 46/94] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:56 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:56.611117 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-634a5198-5b51-4847-ba4d-c8dc7978e3fc tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:56.611733 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-634a5198-5b51-4847-ba4d-c8dc7978e3fc tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:56.618588 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-634a5198-5b51-4847-ba4d-c8dc7978e3fc tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:56.619138 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-634a5198-5b51-4847-ba4d-c8dc7978e3fc tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:56.619582 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-634a5198-5b51-4847-ba4d-c8dc7978e3fc tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:56.620891 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-634a5198-5b51-4847-ba4d-c8dc7978e3fc tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:56.620891 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-634a5198-5b51-4847-ba4d-c8dc7978e3fc tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:56.622741 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-634a5198-5b51-4847-ba4d-c8dc7978e3fc tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:56.651024 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-fe69e4a2-202b-4ab0-9146-60a8d45bc966 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:56.651947 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-fe69e4a2-202b-4ab0-9146-60a8d45bc966 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:56.659031 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fe69e4a2-202b-4ab0-9146-60a8d45bc966 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:56.659761 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fe69e4a2-202b-4ab0-9146-60a8d45bc966 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:56.660387 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fe69e4a2-202b-4ab0-9146-60a8d45bc966 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:56.661254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fe69e4a2-202b-4ab0-9146-60a8d45bc966 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:56.661856 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fe69e4a2-202b-4ab0-9146-60a8d45bc966 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:56.662440 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fe69e4a2-202b-4ab0-9146-60a8d45bc966 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:56.815032 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-634a5198-5b51-4847-ba4d-c8dc7978e3fc tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:56.824260 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-634a5198-5b51-4847-ba4d-c8dc7978e3fc tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.216911 Oct 24 13:25:56.825593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 49/95] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:56 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:56.876471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-fe69e4a2-202b-4ab0-9146-60a8d45bc966 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:56.887016 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-fe69e4a2-202b-4ab0-9146-60a8d45bc966 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.239769 Oct 24 13:25:56.888105 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 47/96] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:56 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:25:57.016634 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-00b1d888-e393-42d4-9390-adfb4408e4d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:57.019625 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-00b1d888-e393-42d4-9390-adfb4408e4d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:57.024445 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-00b1d888-e393-42d4-9390-adfb4408e4d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:57.025573 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-00b1d888-e393-42d4-9390-adfb4408e4d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:57.026139 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-00b1d888-e393-42d4-9390-adfb4408e4d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:57.026893 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-00b1d888-e393-42d4-9390-adfb4408e4d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:57.027425 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-00b1d888-e393-42d4-9390-adfb4408e4d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:57.028006 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-00b1d888-e393-42d4-9390-adfb4408e4d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:57.183441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-00b1d888-e393-42d4-9390-adfb4408e4d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:57.191668 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-00b1d888-e393-42d4-9390-adfb4408e4d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:57.193132 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-00b1d888-e393-42d4-9390-adfb4408e4d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:57.194227 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-00b1d888-e393-42d4-9390-adfb4408e4d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.189384 Oct 24 13:25:57.194859 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 50/97] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:25:57 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:25:57.266685 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b6075cdf-8053-4ba7-8d28-91512d07a811 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:57.267390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b6075cdf-8053-4ba7-8d28-91512d07a811 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:57.274240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6075cdf-8053-4ba7-8d28-91512d07a811 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:57.274786 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6075cdf-8053-4ba7-8d28-91512d07a811 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:57.275280 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6075cdf-8053-4ba7-8d28-91512d07a811 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:57.276057 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6075cdf-8053-4ba7-8d28-91512d07a811 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:57.276633 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6075cdf-8053-4ba7-8d28-91512d07a811 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:57.277113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6075cdf-8053-4ba7-8d28-91512d07a811 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:57.438885 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b6075cdf-8053-4ba7-8d28-91512d07a811 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:57.446653 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b6075cdf-8053-4ba7-8d28-91512d07a811 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.183857 Oct 24 13:25:57.447223 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 48/98] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:57 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:57.847603 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-167d968b-2cc5-4df0-b61d-a0a3701679e4 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:57.847603 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-167d968b-2cc5-4df0-b61d-a0a3701679e4 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:57.853694 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-167d968b-2cc5-4df0-b61d-a0a3701679e4 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:57.854259 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-167d968b-2cc5-4df0-b61d-a0a3701679e4 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:57.854859 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-167d968b-2cc5-4df0-b61d-a0a3701679e4 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:57.855790 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-167d968b-2cc5-4df0-b61d-a0a3701679e4 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:57.856555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-167d968b-2cc5-4df0-b61d-a0a3701679e4 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:57.857375 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-167d968b-2cc5-4df0-b61d-a0a3701679e4 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:57.910475 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-d4c3b1ce-0bfa-4ee4-921c-4190257da45e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:57.911856 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-d4c3b1ce-0bfa-4ee4-921c-4190257da45e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:57.917638 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d4c3b1ce-0bfa-4ee4-921c-4190257da45e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:57.918308 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d4c3b1ce-0bfa-4ee4-921c-4190257da45e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:57.918741 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d4c3b1ce-0bfa-4ee4-921c-4190257da45e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:57.919547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d4c3b1ce-0bfa-4ee4-921c-4190257da45e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:57.919871 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d4c3b1ce-0bfa-4ee4-921c-4190257da45e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:57.920603 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d4c3b1ce-0bfa-4ee4-921c-4190257da45e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:58.014201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-167d968b-2cc5-4df0-b61d-a0a3701679e4 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:58.022281 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-167d968b-2cc5-4df0-b61d-a0a3701679e4 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.179155 Oct 24 13:25:58.022866 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 51/99] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:57 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:58.068961 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-d4c3b1ce-0bfa-4ee4-921c-4190257da45e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:58.077606 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-d4c3b1ce-0bfa-4ee4-921c-4190257da45e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.171210 Oct 24 13:25:58.078181 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 49/100] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:57 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:25:58.221326 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-086bdaca-6ffc-4f8a-8808-2e922a9bdfbd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:58.221937 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-086bdaca-6ffc-4f8a-8808-2e922a9bdfbd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:58.229371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-086bdaca-6ffc-4f8a-8808-2e922a9bdfbd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:58.229875 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-086bdaca-6ffc-4f8a-8808-2e922a9bdfbd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:58.230305 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-086bdaca-6ffc-4f8a-8808-2e922a9bdfbd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:58.231156 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-086bdaca-6ffc-4f8a-8808-2e922a9bdfbd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:58.231616 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-086bdaca-6ffc-4f8a-8808-2e922a9bdfbd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:58.232041 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-086bdaca-6ffc-4f8a-8808-2e922a9bdfbd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:58.369247 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-086bdaca-6ffc-4f8a-8808-2e922a9bdfbd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:58.377555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-086bdaca-6ffc-4f8a-8808-2e922a9bdfbd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:58.379097 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-086bdaca-6ffc-4f8a-8808-2e922a9bdfbd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:58.380144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-086bdaca-6ffc-4f8a-8808-2e922a9bdfbd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.163343 Oct 24 13:25:58.380731 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 52/101] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:25:58 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:25:58.473514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-bd8d74a6-6b69-4752-b7a1-24e111ccc63a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:58.474269 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-bd8d74a6-6b69-4752-b7a1-24e111ccc63a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:58.477350 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=6 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:58.480831 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bd8d74a6-6b69-4752-b7a1-24e111ccc63a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:58.481313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bd8d74a6-6b69-4752-b7a1-24e111ccc63a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:58.481893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bd8d74a6-6b69-4752-b7a1-24e111ccc63a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:58.482735 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bd8d74a6-6b69-4752-b7a1-24e111ccc63a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:58.483317 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bd8d74a6-6b69-4752-b7a1-24e111ccc63a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:58.483920 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bd8d74a6-6b69-4752-b7a1-24e111ccc63a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:58.619162 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-bd8d74a6-6b69-4752-b7a1-24e111ccc63a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:58.626750 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-bd8d74a6-6b69-4752-b7a1-24e111ccc63a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.157172 Oct 24 13:25:58.627316 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 50/102] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:58 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:59.056861 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-712d6c85-b81c-4094-92f6-4081c9f4998b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:59.056861 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-712d6c85-b81c-4094-92f6-4081c9f4998b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:59.056861 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-712d6c85-b81c-4094-92f6-4081c9f4998b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:59.056861 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-712d6c85-b81c-4094-92f6-4081c9f4998b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:59.057722 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-712d6c85-b81c-4094-92f6-4081c9f4998b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:59.057722 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-712d6c85-b81c-4094-92f6-4081c9f4998b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:59.057722 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-712d6c85-b81c-4094-92f6-4081c9f4998b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:59.057722 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-712d6c85-b81c-4094-92f6-4081c9f4998b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:59.102100 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ebc35da0-736d-4dcd-a531-174cb70b109d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:59.102829 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ebc35da0-736d-4dcd-a531-174cb70b109d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:59.109531 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ebc35da0-736d-4dcd-a531-174cb70b109d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:59.110232 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ebc35da0-736d-4dcd-a531-174cb70b109d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:59.110985 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ebc35da0-736d-4dcd-a531-174cb70b109d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:59.111846 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ebc35da0-736d-4dcd-a531-174cb70b109d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:59.112317 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ebc35da0-736d-4dcd-a531-174cb70b109d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:59.118707 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ebc35da0-736d-4dcd-a531-174cb70b109d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:59.224083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-712d6c85-b81c-4094-92f6-4081c9f4998b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:59.233014 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-712d6c85-b81c-4094-92f6-4081c9f4998b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.191240 Oct 24 13:25:59.233795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 53/103] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:59 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:59.253585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ebc35da0-736d-4dcd-a531-174cb70b109d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:59.262120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ebc35da0-736d-4dcd-a531-174cb70b109d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.164289 Oct 24 13:25:59.276821 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 51/104] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:59 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:25:59.406822 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c8d86e81-9239-4ec7-ba93-aac9537c21d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:59.407735 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c8d86e81-9239-4ec7-ba93-aac9537c21d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:59.415200 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c8d86e81-9239-4ec7-ba93-aac9537c21d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:59.415676 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c8d86e81-9239-4ec7-ba93-aac9537c21d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:59.416097 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c8d86e81-9239-4ec7-ba93-aac9537c21d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:59.416943 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c8d86e81-9239-4ec7-ba93-aac9537c21d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:59.417381 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c8d86e81-9239-4ec7-ba93-aac9537c21d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:59.417827 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c8d86e81-9239-4ec7-ba93-aac9537c21d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:59.546970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c8d86e81-9239-4ec7-ba93-aac9537c21d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:59.555840 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c8d86e81-9239-4ec7-ba93-aac9537c21d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:59.557319 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c8d86e81-9239-4ec7-ba93-aac9537c21d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:59.558429 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c8d86e81-9239-4ec7-ba93-aac9537c21d7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.155987 Oct 24 13:25:59.558988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 54/105] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:25:59 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:25:59.650922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a1405419-8cee-4117-ae0b-02a5f5b766d2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:59.651572 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a1405419-8cee-4117-ae0b-02a5f5b766d2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:59.657565 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1405419-8cee-4117-ae0b-02a5f5b766d2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:59.658308 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1405419-8cee-4117-ae0b-02a5f5b766d2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:59.658735 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1405419-8cee-4117-ae0b-02a5f5b766d2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:59.659420 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1405419-8cee-4117-ae0b-02a5f5b766d2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:59.659878 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1405419-8cee-4117-ae0b-02a5f5b766d2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:59.660313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1405419-8cee-4117-ae0b-02a5f5b766d2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:59.802273 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a1405419-8cee-4117-ae0b-02a5f5b766d2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:59.810465 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a1405419-8cee-4117-ae0b-02a5f5b766d2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.164636 Oct 24 13:25:59.811123 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 52/106] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:59 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:00.258001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-0f2a0ce9-234a-44f7-9e81-7a623b96cd7f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:00.258547 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-0f2a0ce9-234a-44f7-9e81-7a623b96cd7f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:00.264509 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0f2a0ce9-234a-44f7-9e81-7a623b96cd7f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:00.264988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0f2a0ce9-234a-44f7-9e81-7a623b96cd7f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:00.265417 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0f2a0ce9-234a-44f7-9e81-7a623b96cd7f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:00.266102 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0f2a0ce9-234a-44f7-9e81-7a623b96cd7f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:00.266549 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0f2a0ce9-234a-44f7-9e81-7a623b96cd7f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:00.266967 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0f2a0ce9-234a-44f7-9e81-7a623b96cd7f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:00.285832 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e738a3ac-e790-4f2f-a375-320c6f7a007d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:00.286985 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e738a3ac-e790-4f2f-a375-320c6f7a007d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:00.293543 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e738a3ac-e790-4f2f-a375-320c6f7a007d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:00.294016 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e738a3ac-e790-4f2f-a375-320c6f7a007d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:00.294444 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e738a3ac-e790-4f2f-a375-320c6f7a007d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:00.295241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e738a3ac-e790-4f2f-a375-320c6f7a007d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:00.295602 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e738a3ac-e790-4f2f-a375-320c6f7a007d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:00.297533 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e738a3ac-e790-4f2f-a375-320c6f7a007d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:00.417025 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-0f2a0ce9-234a-44f7-9e81-7a623b96cd7f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:00.427433 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-0f2a0ce9-234a-44f7-9e81-7a623b96cd7f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.173376 Oct 24 13:26:00.428033 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 55/107] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:00 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:00.442341 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e738a3ac-e790-4f2f-a375-320c6f7a007d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:00.450217 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e738a3ac-e790-4f2f-a375-320c6f7a007d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.168166 Oct 24 13:26:00.450776 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 53/108] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:00 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:00.583241 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ba5e637a-b313-4da0-90d3-32a69a1fcf98 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:00.583852 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-ba5e637a-b313-4da0-90d3-32a69a1fcf98 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:00.590327 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ba5e637a-b313-4da0-90d3-32a69a1fcf98 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:00.590801 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ba5e637a-b313-4da0-90d3-32a69a1fcf98 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:00.591230 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ba5e637a-b313-4da0-90d3-32a69a1fcf98 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:00.591907 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ba5e637a-b313-4da0-90d3-32a69a1fcf98 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:00.592383 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ba5e637a-b313-4da0-90d3-32a69a1fcf98 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:00.592803 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ba5e637a-b313-4da0-90d3-32a69a1fcf98 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:00.738726 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ba5e637a-b313-4da0-90d3-32a69a1fcf98 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:00.747077 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ba5e637a-b313-4da0-90d3-32a69a1fcf98 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:00.748551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ba5e637a-b313-4da0-90d3-32a69a1fcf98 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:00.749746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-ba5e637a-b313-4da0-90d3-32a69a1fcf98 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.170592 Oct 24 13:26:00.750306 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 56/109] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:00 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:00.838938 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-902f3627-4078-4d19-971f-6bf9c0b1d495 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:00.839555 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-902f3627-4078-4d19-971f-6bf9c0b1d495 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:00.845689 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-902f3627-4078-4d19-971f-6bf9c0b1d495 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:00.846471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-902f3627-4078-4d19-971f-6bf9c0b1d495 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:00.846843 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-902f3627-4078-4d19-971f-6bf9c0b1d495 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:00.847951 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-902f3627-4078-4d19-971f-6bf9c0b1d495 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:00.848590 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-902f3627-4078-4d19-971f-6bf9c0b1d495 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:00.849012 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-902f3627-4078-4d19-971f-6bf9c0b1d495 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:00.868126 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=100 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:00.978683 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-902f3627-4078-4d19-971f-6bf9c0b1d495 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:00.986190 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-902f3627-4078-4d19-971f-6bf9c0b1d495 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.152704 Oct 24 13:26:00.986752 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 54/110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:00 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:01.450967 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-52c834de-dec1-417c-8c78-102a192d00a5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:01.451600 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-52c834de-dec1-417c-8c78-102a192d00a5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:01.457998 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-52c834de-dec1-417c-8c78-102a192d00a5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:01.458685 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-52c834de-dec1-417c-8c78-102a192d00a5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:01.459253 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-52c834de-dec1-417c-8c78-102a192d00a5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:01.460078 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-52c834de-dec1-417c-8c78-102a192d00a5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:01.460692 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-52c834de-dec1-417c-8c78-102a192d00a5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:01.461269 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-52c834de-dec1-417c-8c78-102a192d00a5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:01.473051 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-687477ca-49bb-44b2-8376-e89399197f97 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:01.473650 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-687477ca-49bb-44b2-8376-e89399197f97 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:01.480162 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-687477ca-49bb-44b2-8376-e89399197f97 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:01.480870 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-687477ca-49bb-44b2-8376-e89399197f97 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:01.481452 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-687477ca-49bb-44b2-8376-e89399197f97 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:01.482287 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-687477ca-49bb-44b2-8376-e89399197f97 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:01.482884 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-687477ca-49bb-44b2-8376-e89399197f97 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:01.483303 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-687477ca-49bb-44b2-8376-e89399197f97 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:01.597618 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-52c834de-dec1-417c-8c78-102a192d00a5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:01.606451 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-52c834de-dec1-417c-8c78-102a192d00a5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.159141 Oct 24 13:26:01.607041 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 57/111] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:01 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:01.617111 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-687477ca-49bb-44b2-8376-e89399197f97 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:01.624846 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-687477ca-49bb-44b2-8376-e89399197f97 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.155597 Oct 24 13:26:01.625439 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 55/112] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:01 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:01.775600 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bbcddc22-8468-43fe-8740-0f59d1ddce70 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:01.776242 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bbcddc22-8468-43fe-8740-0f59d1ddce70 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:01.782520 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bbcddc22-8468-43fe-8740-0f59d1ddce70 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:01.783006 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bbcddc22-8468-43fe-8740-0f59d1ddce70 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:01.783437 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bbcddc22-8468-43fe-8740-0f59d1ddce70 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:01.784218 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bbcddc22-8468-43fe-8740-0f59d1ddce70 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:01.788922 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bbcddc22-8468-43fe-8740-0f59d1ddce70 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:01.788922 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bbcddc22-8468-43fe-8740-0f59d1ddce70 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:01.789803 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=100 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:01.960753 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-bbcddc22-8468-43fe-8740-0f59d1ddce70 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:01.971573 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-bbcddc22-8468-43fe-8740-0f59d1ddce70 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:01.973096 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-bbcddc22-8468-43fe-8740-0f59d1ddce70 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:01.974209 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-bbcddc22-8468-43fe-8740-0f59d1ddce70 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.203171 Oct 24 13:26:01.974768 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 58/113] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:01 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:02.009522 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-45415941-8501-4f45-91c0-78c59705887e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:02.010746 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-45415941-8501-4f45-91c0-78c59705887e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:02.017028 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-45415941-8501-4f45-91c0-78c59705887e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:02.017507 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-45415941-8501-4f45-91c0-78c59705887e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:02.021670 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-45415941-8501-4f45-91c0-78c59705887e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:02.023133 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-45415941-8501-4f45-91c0-78c59705887e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:02.024164 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-45415941-8501-4f45-91c0-78c59705887e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:02.024768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-45415941-8501-4f45-91c0-78c59705887e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:02.231418 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-45415941-8501-4f45-91c0-78c59705887e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:02.239247 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-45415941-8501-4f45-91c0-78c59705887e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.233650 Oct 24 13:26:02.245634 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 56/114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:02 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:02.629319 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-41ba95db-f31a-4020-91a8-68c9f8098ce8 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:02.629942 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-41ba95db-f31a-4020-91a8-68c9f8098ce8 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:02.636723 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-41ba95db-f31a-4020-91a8-68c9f8098ce8 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:02.637449 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-41ba95db-f31a-4020-91a8-68c9f8098ce8 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:02.638121 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-41ba95db-f31a-4020-91a8-68c9f8098ce8 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:02.638795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-41ba95db-f31a-4020-91a8-68c9f8098ce8 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:02.639245 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-41ba95db-f31a-4020-91a8-68c9f8098ce8 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:02.639657 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-41ba95db-f31a-4020-91a8-68c9f8098ce8 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:02.647222 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6ae4c151-93b4-48bb-aac2-675bd29f2f99 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:02.647979 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-6ae4c151-93b4-48bb-aac2-675bd29f2f99 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:02.655155 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ae4c151-93b4-48bb-aac2-675bd29f2f99 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:02.655155 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ae4c151-93b4-48bb-aac2-675bd29f2f99 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:02.655538 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ae4c151-93b4-48bb-aac2-675bd29f2f99 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:02.656361 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ae4c151-93b4-48bb-aac2-675bd29f2f99 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:02.656803 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ae4c151-93b4-48bb-aac2-675bd29f2f99 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:02.657216 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ae4c151-93b4-48bb-aac2-675bd29f2f99 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:02.836455 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-41ba95db-f31a-4020-91a8-68c9f8098ce8 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:02.836600 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-6ae4c151-93b4-48bb-aac2-675bd29f2f99 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:02.844494 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6ae4c151-93b4-48bb-aac2-675bd29f2f99 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.200907 Oct 24 13:26:02.844694 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-41ba95db-f31a-4020-91a8-68c9f8098ce8 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.219026 Oct 24 13:26:02.845084 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 57/115] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:02 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:02.845817 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 59/116] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:02 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:03.001629 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-cc0660dc-ff84-4b02-9cbe-14dc67808c14 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:03.002222 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-cc0660dc-ff84-4b02-9cbe-14dc67808c14 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:03.008595 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cc0660dc-ff84-4b02-9cbe-14dc67808c14 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:03.009067 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cc0660dc-ff84-4b02-9cbe-14dc67808c14 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:03.009488 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cc0660dc-ff84-4b02-9cbe-14dc67808c14 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:03.010163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cc0660dc-ff84-4b02-9cbe-14dc67808c14 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:03.011242 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cc0660dc-ff84-4b02-9cbe-14dc67808c14 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:03.011660 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cc0660dc-ff84-4b02-9cbe-14dc67808c14 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:03.141001 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-cc0660dc-ff84-4b02-9cbe-14dc67808c14 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:03.149010 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-cc0660dc-ff84-4b02-9cbe-14dc67808c14 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:03.150453 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-cc0660dc-ff84-4b02-9cbe-14dc67808c14 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:03.151540 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-cc0660dc-ff84-4b02-9cbe-14dc67808c14 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.153843 Oct 24 13:26:03.152091 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 58/117] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:02 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:03.267380 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bb332fa8-6260-401d-8e84-2fdb6f9862c0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:03.267989 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bb332fa8-6260-401d-8e84-2fdb6f9862c0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:03.275404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb332fa8-6260-401d-8e84-2fdb6f9862c0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:03.276079 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb332fa8-6260-401d-8e84-2fdb6f9862c0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:03.276535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb332fa8-6260-401d-8e84-2fdb6f9862c0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:03.277218 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb332fa8-6260-401d-8e84-2fdb6f9862c0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:03.277658 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb332fa8-6260-401d-8e84-2fdb6f9862c0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:03.278071 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb332fa8-6260-401d-8e84-2fdb6f9862c0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:03.419110 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-bb332fa8-6260-401d-8e84-2fdb6f9862c0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:03.427070 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-bb332fa8-6260-401d-8e84-2fdb6f9862c0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.163528 Oct 24 13:26:03.427640 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 60/118] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:03 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:03.868866 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-d4b0fce3-f741-456d-addc-ba0ee4e09ebe tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:03.869183 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c01d4c00-8481-4dc9-b489-304ebb8a7fef tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:03.869676 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-d4b0fce3-f741-456d-addc-ba0ee4e09ebe tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:03.869936 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c01d4c00-8481-4dc9-b489-304ebb8a7fef tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:03.875562 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d4b0fce3-f741-456d-addc-ba0ee4e09ebe tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:03.876033 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d4b0fce3-f741-456d-addc-ba0ee4e09ebe tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:03.876863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c01d4c00-8481-4dc9-b489-304ebb8a7fef tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:03.876978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d4b0fce3-f741-456d-addc-ba0ee4e09ebe tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:03.877078 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c01d4c00-8481-4dc9-b489-304ebb8a7fef tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:03.877165 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d4b0fce3-f741-456d-addc-ba0ee4e09ebe tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:03.877343 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c01d4c00-8481-4dc9-b489-304ebb8a7fef tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:03.877596 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d4b0fce3-f741-456d-addc-ba0ee4e09ebe tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:03.878006 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d4b0fce3-f741-456d-addc-ba0ee4e09ebe tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:03.878099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c01d4c00-8481-4dc9-b489-304ebb8a7fef tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:03.878442 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c01d4c00-8481-4dc9-b489-304ebb8a7fef tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:03.878853 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c01d4c00-8481-4dc9-b489-304ebb8a7fef tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:04.010798 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c01d4c00-8481-4dc9-b489-304ebb8a7fef tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:04.017522 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-d4b0fce3-f741-456d-addc-ba0ee4e09ebe tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:04.020756 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c01d4c00-8481-4dc9-b489-304ebb8a7fef tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.155871 Oct 24 13:26:04.020756 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 61/119] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:03 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:04.032193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-d4b0fce3-f741-456d-addc-ba0ee4e09ebe tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.164462 Oct 24 13:26:04.032193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 59/120] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:03 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:04.177146 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-6b314680-08cc-445b-95b5-e3d9e2265b3b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:04.177798 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-6b314680-08cc-445b-95b5-e3d9e2265b3b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:04.183651 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6b314680-08cc-445b-95b5-e3d9e2265b3b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:04.184112 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6b314680-08cc-445b-95b5-e3d9e2265b3b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:04.184574 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6b314680-08cc-445b-95b5-e3d9e2265b3b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:04.185245 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6b314680-08cc-445b-95b5-e3d9e2265b3b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:04.185678 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6b314680-08cc-445b-95b5-e3d9e2265b3b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:04.186085 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6b314680-08cc-445b-95b5-e3d9e2265b3b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:04.325248 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6b314680-08cc-445b-95b5-e3d9e2265b3b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:04.337513 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6b314680-08cc-445b-95b5-e3d9e2265b3b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:04.338963 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6b314680-08cc-445b-95b5-e3d9e2265b3b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:04.340085 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-6b314680-08cc-445b-95b5-e3d9e2265b3b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.166854 Oct 24 13:26:04.340669 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 62/121] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:04 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:04.451314 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-928ca2e0-aee9-4526-8664-39813adbba2a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:04.451917 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-928ca2e0-aee9-4526-8664-39813adbba2a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:04.458071 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-928ca2e0-aee9-4526-8664-39813adbba2a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:04.458540 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-928ca2e0-aee9-4526-8664-39813adbba2a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:04.458960 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-928ca2e0-aee9-4526-8664-39813adbba2a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:04.459627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-928ca2e0-aee9-4526-8664-39813adbba2a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:04.460776 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-928ca2e0-aee9-4526-8664-39813adbba2a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:04.461190 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-928ca2e0-aee9-4526-8664-39813adbba2a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:04.592811 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-928ca2e0-aee9-4526-8664-39813adbba2a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:04.600579 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-928ca2e0-aee9-4526-8664-39813adbba2a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.153000 Oct 24 13:26:04.601139 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 60/122] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:04 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:05.044304 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-2387679e-9499-4355-8348-7b5380da1bf8 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:05.044843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-2387679e-9499-4355-8348-7b5380da1bf8 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:05.050758 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7d68090c-ab1f-4178-97b6-51d66655b90d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:05.051218 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2387679e-9499-4355-8348-7b5380da1bf8 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:05.051361 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-7d68090c-ab1f-4178-97b6-51d66655b90d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:05.051538 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2387679e-9499-4355-8348-7b5380da1bf8 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:05.052005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2387679e-9499-4355-8348-7b5380da1bf8 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:05.053029 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2387679e-9499-4355-8348-7b5380da1bf8 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:05.053485 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2387679e-9499-4355-8348-7b5380da1bf8 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:05.053945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2387679e-9499-4355-8348-7b5380da1bf8 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:05.057441 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7d68090c-ab1f-4178-97b6-51d66655b90d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:05.057917 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7d68090c-ab1f-4178-97b6-51d66655b90d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:05.058342 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7d68090c-ab1f-4178-97b6-51d66655b90d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:05.059016 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7d68090c-ab1f-4178-97b6-51d66655b90d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:05.059617 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7d68090c-ab1f-4178-97b6-51d66655b90d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:05.060188 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7d68090c-ab1f-4178-97b6-51d66655b90d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:05.210840 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-2387679e-9499-4355-8348-7b5380da1bf8 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:05.212619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-7d68090c-ab1f-4178-97b6-51d66655b90d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:05.218783 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-2387679e-9499-4355-8348-7b5380da1bf8 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.178392 Oct 24 13:26:05.219356 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 63/123] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:05 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:05.220248 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-7d68090c-ab1f-4178-97b6-51d66655b90d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.173205 Oct 24 13:26:05.220903 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 61/124] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:05 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:05.364070 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-497a30dc-1b6f-4cdc-908b-b77b42093498 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:05.364741 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-497a30dc-1b6f-4cdc-908b-b77b42093498 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:05.370648 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-497a30dc-1b6f-4cdc-908b-b77b42093498 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:05.371127 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-497a30dc-1b6f-4cdc-908b-b77b42093498 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:05.371550 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-497a30dc-1b6f-4cdc-908b-b77b42093498 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:05.372440 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-497a30dc-1b6f-4cdc-908b-b77b42093498 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:05.373729 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-497a30dc-1b6f-4cdc-908b-b77b42093498 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:05.374155 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-497a30dc-1b6f-4cdc-908b-b77b42093498 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:05.514632 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-497a30dc-1b6f-4cdc-908b-b77b42093498 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:05.524013 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-497a30dc-1b6f-4cdc-908b-b77b42093498 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:05.525567 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-497a30dc-1b6f-4cdc-908b-b77b42093498 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:05.526756 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-497a30dc-1b6f-4cdc-908b-b77b42093498 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.166498 Oct 24 13:26:05.527424 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 64/125] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:05 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:05.623393 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a54ac4bc-7d63-441a-9ca1-7a38d5ed5bb6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:05.625446 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a54ac4bc-7d63-441a-9ca1-7a38d5ed5bb6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:05.631273 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a54ac4bc-7d63-441a-9ca1-7a38d5ed5bb6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:05.631767 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a54ac4bc-7d63-441a-9ca1-7a38d5ed5bb6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:05.632731 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a54ac4bc-7d63-441a-9ca1-7a38d5ed5bb6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:05.636679 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a54ac4bc-7d63-441a-9ca1-7a38d5ed5bb6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:05.636679 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a54ac4bc-7d63-441a-9ca1-7a38d5ed5bb6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:05.636679 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a54ac4bc-7d63-441a-9ca1-7a38d5ed5bb6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:05.772860 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a54ac4bc-7d63-441a-9ca1-7a38d5ed5bb6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:05.782047 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a54ac4bc-7d63-441a-9ca1-7a38d5ed5bb6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.162471 Oct 24 13:26:05.783755 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 62/126] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:05 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:06.242688 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a8db2cc5-ec5b-4987-a3b5-f5740d46eeda tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:06.243218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b84dd7d6-f583-411c-b2c2-c4a9f95b65ec tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:06.243771 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b84dd7d6-f583-411c-b2c2-c4a9f95b65ec tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:06.244698 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a8db2cc5-ec5b-4987-a3b5-f5740d46eeda tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:06.250190 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b84dd7d6-f583-411c-b2c2-c4a9f95b65ec tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:06.251035 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a8db2cc5-ec5b-4987-a3b5-f5740d46eeda tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:06.251226 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b84dd7d6-f583-411c-b2c2-c4a9f95b65ec tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:06.251664 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b84dd7d6-f583-411c-b2c2-c4a9f95b65ec tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:06.252045 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a8db2cc5-ec5b-4987-a3b5-f5740d46eeda tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:06.252540 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b84dd7d6-f583-411c-b2c2-c4a9f95b65ec tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:06.252883 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b84dd7d6-f583-411c-b2c2-c4a9f95b65ec tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:06.253306 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a8db2cc5-ec5b-4987-a3b5-f5740d46eeda tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:06.253406 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b84dd7d6-f583-411c-b2c2-c4a9f95b65ec tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:06.254578 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a8db2cc5-ec5b-4987-a3b5-f5740d46eeda tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:06.255432 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a8db2cc5-ec5b-4987-a3b5-f5740d46eeda tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:06.256294 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a8db2cc5-ec5b-4987-a3b5-f5740d46eeda tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:06.402226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a8db2cc5-ec5b-4987-a3b5-f5740d46eeda tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:06.402601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b84dd7d6-f583-411c-b2c2-c4a9f95b65ec tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:06.410391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a8db2cc5-ec5b-4987-a3b5-f5740d46eeda tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.171471 Oct 24 13:26:06.410970 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b84dd7d6-f583-411c-b2c2-c4a9f95b65ec tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.172053 Oct 24 13:26:06.411276 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 65/127] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:06 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:06.412251 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 63/128] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:06 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:06.551136 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-370fe11e-e132-46b8-94df-ae35fb0147f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:06.551742 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-370fe11e-e132-46b8-94df-ae35fb0147f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:06.558248 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-370fe11e-e132-46b8-94df-ae35fb0147f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:06.558716 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-370fe11e-e132-46b8-94df-ae35fb0147f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:06.559139 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-370fe11e-e132-46b8-94df-ae35fb0147f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:06.559806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-370fe11e-e132-46b8-94df-ae35fb0147f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:06.560245 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-370fe11e-e132-46b8-94df-ae35fb0147f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:06.560680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-370fe11e-e132-46b8-94df-ae35fb0147f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:06.689208 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-370fe11e-e132-46b8-94df-ae35fb0147f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:06.697713 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-370fe11e-e132-46b8-94df-ae35fb0147f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:06.699158 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-370fe11e-e132-46b8-94df-ae35fb0147f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:06.700394 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-370fe11e-e132-46b8-94df-ae35fb0147f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.153185 Oct 24 13:26:06.701121 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 66/129] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:06 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:26:06.805080 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-67c21289-94fe-4c7c-b60a-7f83201492d2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:06.805704 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-67c21289-94fe-4c7c-b60a-7f83201492d2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:06.811575 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-67c21289-94fe-4c7c-b60a-7f83201492d2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:06.812044 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-67c21289-94fe-4c7c-b60a-7f83201492d2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:06.812504 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-67c21289-94fe-4c7c-b60a-7f83201492d2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:06.813175 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-67c21289-94fe-4c7c-b60a-7f83201492d2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:06.813637 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-67c21289-94fe-4c7c-b60a-7f83201492d2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:06.814048 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-67c21289-94fe-4c7c-b60a-7f83201492d2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:06.941255 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-67c21289-94fe-4c7c-b60a-7f83201492d2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:06.949296 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-67c21289-94fe-4c7c-b60a-7f83201492d2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.148223 Oct 24 13:26:06.949857 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 64/130] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:06 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:07.433855 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-79f87a5e-fde2-46bc-a9c9-24dbf3eeaefd tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:07.434454 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-111d19a2-dfa0-4265-a86e-51bf746f273d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:07.434813 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-79f87a5e-fde2-46bc-a9c9-24dbf3eeaefd tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:07.434896 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-111d19a2-dfa0-4265-a86e-51bf746f273d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:07.440808 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-79f87a5e-fde2-46bc-a9c9-24dbf3eeaefd tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:07.441131 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-111d19a2-dfa0-4265-a86e-51bf746f273d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:07.441497 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-79f87a5e-fde2-46bc-a9c9-24dbf3eeaefd tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:07.441765 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-111d19a2-dfa0-4265-a86e-51bf746f273d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:07.441944 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-79f87a5e-fde2-46bc-a9c9-24dbf3eeaefd tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:07.442193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-111d19a2-dfa0-4265-a86e-51bf746f273d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:07.442708 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-79f87a5e-fde2-46bc-a9c9-24dbf3eeaefd tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:07.442870 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-111d19a2-dfa0-4265-a86e-51bf746f273d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:07.443311 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-111d19a2-dfa0-4265-a86e-51bf746f273d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:07.443423 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-79f87a5e-fde2-46bc-a9c9-24dbf3eeaefd tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:07.443721 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-111d19a2-dfa0-4265-a86e-51bf746f273d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:07.443838 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-79f87a5e-fde2-46bc-a9c9-24dbf3eeaefd tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:07.583413 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-79f87a5e-fde2-46bc-a9c9-24dbf3eeaefd tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:07.591310 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-79f87a5e-fde2-46bc-a9c9-24dbf3eeaefd tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.161205 Oct 24 13:26:07.591819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 67/131] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:07 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:07.726505 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-fbef672a-4710-45e9-8368-09cb00229491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:07.727295 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-fbef672a-4710-45e9-8368-09cb00229491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:07.733315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fbef672a-4710-45e9-8368-09cb00229491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:07.733800 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fbef672a-4710-45e9-8368-09cb00229491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:07.734229 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fbef672a-4710-45e9-8368-09cb00229491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:07.734973 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fbef672a-4710-45e9-8368-09cb00229491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:07.735458 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fbef672a-4710-45e9-8368-09cb00229491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:07.735881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fbef672a-4710-45e9-8368-09cb00229491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:07.853776 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-111d19a2-dfa0-4265-a86e-51bf746f273d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:07.861984 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-111d19a2-dfa0-4265-a86e-51bf746f273d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.431370 Oct 24 13:26:07.863357 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 65/132] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:07 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:07.886389 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fbef672a-4710-45e9-8368-09cb00229491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:07.896362 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fbef672a-4710-45e9-8368-09cb00229491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:07.898874 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fbef672a-4710-45e9-8368-09cb00229491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:07.900108 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-fbef672a-4710-45e9-8368-09cb00229491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.178174 Oct 24 13:26:07.900813 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 68/133] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:07 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:26:07.972211 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b1db092e-59f5-40a0-b972-afc21a247ec9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:07.973083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b1db092e-59f5-40a0-b972-afc21a247ec9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:07.979958 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b1db092e-59f5-40a0-b972-afc21a247ec9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:07.980573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b1db092e-59f5-40a0-b972-afc21a247ec9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:07.981189 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b1db092e-59f5-40a0-b972-afc21a247ec9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:07.981959 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b1db092e-59f5-40a0-b972-afc21a247ec9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:07.982494 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b1db092e-59f5-40a0-b972-afc21a247ec9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:07.983287 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b1db092e-59f5-40a0-b972-afc21a247ec9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:08.601611 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b1db092e-59f5-40a0-b972-afc21a247ec9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:08.615836 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-44f0cd43-805a-4b9f-8d95-03858035d176 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:08.617099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-44f0cd43-805a-4b9f-8d95-03858035d176 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:08.625801 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b1db092e-59f5-40a0-b972-afc21a247ec9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.657675 Oct 24 13:26:08.627488 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-44f0cd43-805a-4b9f-8d95-03858035d176 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:08.627725 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 66/134] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:07 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:08.628374 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-44f0cd43-805a-4b9f-8d95-03858035d176 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:08.629051 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-44f0cd43-805a-4b9f-8d95-03858035d176 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:08.632860 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-44f0cd43-805a-4b9f-8d95-03858035d176 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:08.632860 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-44f0cd43-805a-4b9f-8d95-03858035d176 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:08.632860 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-44f0cd43-805a-4b9f-8d95-03858035d176 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:08.767212 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-44f0cd43-805a-4b9f-8d95-03858035d176 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:08.774920 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-44f0cd43-805a-4b9f-8d95-03858035d176 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.163521 Oct 24 13:26:08.775679 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 69/135] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:08 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:08.886850 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-82373663-d8f5-4a0d-ae56-5e93534c1747 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:08.887451 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-82373663-d8f5-4a0d-ae56-5e93534c1747 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:08.894627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-82373663-d8f5-4a0d-ae56-5e93534c1747 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:08.895347 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-82373663-d8f5-4a0d-ae56-5e93534c1747 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:08.903793 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-82373663-d8f5-4a0d-ae56-5e93534c1747 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:08.903793 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-82373663-d8f5-4a0d-ae56-5e93534c1747 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:08.903793 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-82373663-d8f5-4a0d-ae56-5e93534c1747 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:08.903793 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-82373663-d8f5-4a0d-ae56-5e93534c1747 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:08.927343 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-371ddc5b-32a3-438b-af42-3a0d8662613c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:08.928030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-371ddc5b-32a3-438b-af42-3a0d8662613c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:08.941541 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-371ddc5b-32a3-438b-af42-3a0d8662613c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:08.942302 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-371ddc5b-32a3-438b-af42-3a0d8662613c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:08.942899 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-371ddc5b-32a3-438b-af42-3a0d8662613c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:08.943918 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-371ddc5b-32a3-438b-af42-3a0d8662613c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:08.953029 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-371ddc5b-32a3-438b-af42-3a0d8662613c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:08.953722 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-371ddc5b-32a3-438b-af42-3a0d8662613c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:09.107213 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-371ddc5b-32a3-438b-af42-3a0d8662613c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:09.117312 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-371ddc5b-32a3-438b-af42-3a0d8662613c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:09.118998 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-371ddc5b-32a3-438b-af42-3a0d8662613c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:09.120382 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-371ddc5b-32a3-438b-af42-3a0d8662613c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.197171 Oct 24 13:26:09.120956 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 70/136] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:08 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:09.437031 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-82373663-d8f5-4a0d-ae56-5e93534c1747 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:09.445154 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-82373663-d8f5-4a0d-ae56-5e93534c1747 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.562773 Oct 24 13:26:09.447280 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 67/137] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:08 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:09.656032 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-0301577e-ddca-49a4-8ebc-09964477b6cc req-fbffd1b0-3ea1-4308-b1ca-ca945b0d0256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a568b3c6-b364-45d0-a9fa-2bdbde43ccaa", "tag": "bdec5a38-0967-442c-8d70-b3f416f6105f"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:26:09.664712 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-07a4bee5-9926-481d-9f9e-b3d5232d5c4a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:09.665443 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-07a4bee5-9926-481d-9f9e-b3d5232d5c4a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:09.669915 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-0301577e-ddca-49a4-8ebc-09964477b6cc req-fbffd1b0-3ea1-4308-b1ca-ca945b0d0256 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:09.670383 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-0301577e-ddca-49a4-8ebc-09964477b6cc req-fbffd1b0-3ea1-4308-b1ca-ca945b0d0256 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:09.670801 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-0301577e-ddca-49a4-8ebc-09964477b6cc req-fbffd1b0-3ea1-4308-b1ca-ca945b0d0256 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:09.677118 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-07a4bee5-9926-481d-9f9e-b3d5232d5c4a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:09.677118 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-07a4bee5-9926-481d-9f9e-b3d5232d5c4a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:09.677118 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-07a4bee5-9926-481d-9f9e-b3d5232d5c4a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:09.677118 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-07a4bee5-9926-481d-9f9e-b3d5232d5c4a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:09.677503 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-07a4bee5-9926-481d-9f9e-b3d5232d5c4a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:09.677503 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-07a4bee5-9926-481d-9f9e-b3d5232d5c4a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:09.686605 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-0301577e-ddca-49a4-8ebc-09964477b6cc req-fbffd1b0-3ea1-4308-b1ca-ca945b0d0256 service nova] Creating event network-changed:bdec5a38-0967-442c-8d70-b3f416f6105f for instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa on hv-cinder-86249 Oct 24 13:26:09.693271 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-0301577e-ddca-49a4-8ebc-09964477b6cc req-fbffd1b0-3ea1-4308-b1ca-ca945b0d0256 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040942 Oct 24 13:26:09.695179 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 68/138] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:26:09.799653 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0d82467c-b46b-42f6-9f36-6464c270379b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:09.800610 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0d82467c-b46b-42f6-9f36-6464c270379b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:09.808204 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d82467c-b46b-42f6-9f36-6464c270379b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:09.808904 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d82467c-b46b-42f6-9f36-6464c270379b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:09.809397 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d82467c-b46b-42f6-9f36-6464c270379b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:09.810175 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d82467c-b46b-42f6-9f36-6464c270379b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:09.810825 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d82467c-b46b-42f6-9f36-6464c270379b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:09.811425 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d82467c-b46b-42f6-9f36-6464c270379b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:09.852816 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-07a4bee5-9926-481d-9f9e-b3d5232d5c4a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:09.860702 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-07a4bee5-9926-481d-9f9e-b3d5232d5c4a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.208551 Oct 24 13:26:09.861339 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 71/139] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:09 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:09.956185 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0d82467c-b46b-42f6-9f36-6464c270379b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:09.972908 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0d82467c-b46b-42f6-9f36-6464c270379b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.178139 Oct 24 13:26:09.973462 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 69/140] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:09 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:10.145187 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-60714b1b-8ba2-4aa0-ac83-afa97b691c8c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:10.145785 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-60714b1b-8ba2-4aa0-ac83-afa97b691c8c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:10.152317 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-60714b1b-8ba2-4aa0-ac83-afa97b691c8c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:10.152819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-60714b1b-8ba2-4aa0-ac83-afa97b691c8c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:10.153236 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-60714b1b-8ba2-4aa0-ac83-afa97b691c8c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:10.153910 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-60714b1b-8ba2-4aa0-ac83-afa97b691c8c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:10.154377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-60714b1b-8ba2-4aa0-ac83-afa97b691c8c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:10.154845 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-60714b1b-8ba2-4aa0-ac83-afa97b691c8c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:10.286472 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-60714b1b-8ba2-4aa0-ac83-afa97b691c8c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:10.294604 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-60714b1b-8ba2-4aa0-ac83-afa97b691c8c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:10.296193 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-60714b1b-8ba2-4aa0-ac83-afa97b691c8c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:10.300352 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-60714b1b-8ba2-4aa0-ac83-afa97b691c8c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.155855 Oct 24 13:26:10.300352 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 72/141] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:10 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:10.472735 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-2094f0e2-fc20-4fc8-9371-2967b8997bc0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:10.473333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-2094f0e2-fc20-4fc8-9371-2967b8997bc0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:10.479711 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2094f0e2-fc20-4fc8-9371-2967b8997bc0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:10.480171 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2094f0e2-fc20-4fc8-9371-2967b8997bc0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:10.480658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2094f0e2-fc20-4fc8-9371-2967b8997bc0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:10.481322 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2094f0e2-fc20-4fc8-9371-2967b8997bc0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:10.481759 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2094f0e2-fc20-4fc8-9371-2967b8997bc0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:10.482167 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2094f0e2-fc20-4fc8-9371-2967b8997bc0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:10.610222 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-2094f0e2-fc20-4fc8-9371-2967b8997bc0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:10.618464 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-2094f0e2-fc20-4fc8-9371-2967b8997bc0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.149455 Oct 24 13:26:10.618966 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 70/142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:10 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:10.889890 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c479006c-e213-44af-b433-48ad6e5f087e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:10.890665 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c479006c-e213-44af-b433-48ad6e5f087e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:10.896618 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c479006c-e213-44af-b433-48ad6e5f087e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:10.897093 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c479006c-e213-44af-b433-48ad6e5f087e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:10.898179 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c479006c-e213-44af-b433-48ad6e5f087e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:10.898890 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c479006c-e213-44af-b433-48ad6e5f087e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:10.899361 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c479006c-e213-44af-b433-48ad6e5f087e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:10.899775 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c479006c-e213-44af-b433-48ad6e5f087e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:10.995069 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9e6bb48b-e740-4b48-8432-82f6e4b354fb tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:10.999117 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9e6bb48b-e740-4b48-8432-82f6e4b354fb tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:11.011746 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9e6bb48b-e740-4b48-8432-82f6e4b354fb tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:11.012228 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9e6bb48b-e740-4b48-8432-82f6e4b354fb tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:11.012697 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9e6bb48b-e740-4b48-8432-82f6e4b354fb tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:11.013388 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9e6bb48b-e740-4b48-8432-82f6e4b354fb tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:11.013832 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9e6bb48b-e740-4b48-8432-82f6e4b354fb tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:11.014322 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9e6bb48b-e740-4b48-8432-82f6e4b354fb tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:11.040206 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c479006c-e213-44af-b433-48ad6e5f087e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:11.049111 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c479006c-e213-44af-b433-48ad6e5f087e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.163094 Oct 24 13:26:11.050042 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 73/143] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:10 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:11.155602 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9e6bb48b-e740-4b48-8432-82f6e4b354fb tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:11.159140 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=100 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:11.163588 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9e6bb48b-e740-4b48-8432-82f6e4b354fb tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.172446 Oct 24 13:26:11.164151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 71/144] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:10 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:11.324138 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-44b0a5a6-57d8-40a0-bec9-8c610c06de44 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:11.324774 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-44b0a5a6-57d8-40a0-bec9-8c610c06de44 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:11.331232 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-44b0a5a6-57d8-40a0-bec9-8c610c06de44 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:11.331716 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-44b0a5a6-57d8-40a0-bec9-8c610c06de44 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:11.332144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-44b0a5a6-57d8-40a0-bec9-8c610c06de44 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:11.332854 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-44b0a5a6-57d8-40a0-bec9-8c610c06de44 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:11.333298 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-44b0a5a6-57d8-40a0-bec9-8c610c06de44 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:11.333712 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-44b0a5a6-57d8-40a0-bec9-8c610c06de44 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:11.465245 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-44b0a5a6-57d8-40a0-bec9-8c610c06de44 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:11.468765 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=100 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:11.473983 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-44b0a5a6-57d8-40a0-bec9-8c610c06de44 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:11.475397 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-44b0a5a6-57d8-40a0-bec9-8c610c06de44 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:11.476562 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-44b0a5a6-57d8-40a0-bec9-8c610c06de44 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.156297 Oct 24 13:26:11.477173 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 74/145] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:11 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:11.642070 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-93847d4d-89c0-45b1-aa23-767a50261f3f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:11.642850 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-93847d4d-89c0-45b1-aa23-767a50261f3f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:11.649453 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-93847d4d-89c0-45b1-aa23-767a50261f3f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:11.649984 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-93847d4d-89c0-45b1-aa23-767a50261f3f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:11.650437 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-93847d4d-89c0-45b1-aa23-767a50261f3f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:11.651133 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-93847d4d-89c0-45b1-aa23-767a50261f3f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:11.651607 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-93847d4d-89c0-45b1-aa23-767a50261f3f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:11.652111 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-93847d4d-89c0-45b1-aa23-767a50261f3f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:11.728734 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-33585efa-1ca0-407d-9cfd-d53045b67e51 req-d5b61a7f-89d4-4be1-9e04-6af6b1396020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8de4c382-e12d-4068-96c2-58d44e5265db", "tag": "c7b02435-39c6-46a8-a356-81bef309201a"}, {"name": "network-changed", "server_uuid": "d3d04bbb-034d-4cf1-a753-9c4cb48e92bd", "tag": "4dfc7079-30d9-488d-9dfc-1df75d250b32"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:26:11.743557 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-33585efa-1ca0-407d-9cfd-d53045b67e51 req-d5b61a7f-89d4-4be1-9e04-6af6b1396020 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:11.744177 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-33585efa-1ca0-407d-9cfd-d53045b67e51 req-d5b61a7f-89d4-4be1-9e04-6af6b1396020 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:11.744675 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-33585efa-1ca0-407d-9cfd-d53045b67e51 req-d5b61a7f-89d4-4be1-9e04-6af6b1396020 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:11.765423 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-33585efa-1ca0-407d-9cfd-d53045b67e51 req-d5b61a7f-89d4-4be1-9e04-6af6b1396020 service nova] Creating event network-changed:c7b02435-39c6-46a8-a356-81bef309201a for instance 8de4c382-e12d-4068-96c2-58d44e5265db on hv-cinder-86249 Oct 24 13:26:11.766000 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-33585efa-1ca0-407d-9cfd-d53045b67e51 req-d5b61a7f-89d4-4be1-9e04-6af6b1396020 service nova] Creating event network-changed:4dfc7079-30d9-488d-9dfc-1df75d250b32 for instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd on hv-cinder-86249 Oct 24 13:26:11.766589 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-33585efa-1ca0-407d-9cfd-d53045b67e51 req-d5b61a7f-89d4-4be1-9e04-6af6b1396020 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119146) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 13:26:11.767039 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-33585efa-1ca0-407d-9cfd-d53045b67e51 req-d5b61a7f-89d4-4be1-9e04-6af6b1396020 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119146) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 13:26:11.768119 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b9fbc81d-2770-4bf9-aba9-a1f2d6e6a6b6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:11.768594 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b9fbc81d-2770-4bf9-aba9-a1f2d6e6a6b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:11.769015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b9fbc81d-2770-4bf9-aba9-a1f2d6e6a6b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:11.769712 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b9fbc81d-2770-4bf9-aba9-a1f2d6e6a6b6 None None] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:11.770153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b9fbc81d-2770-4bf9-aba9-a1f2d6e6a6b6 None None] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:11.770562 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b9fbc81d-2770-4bf9-aba9-a1f2d6e6a6b6 None None] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:11.779975 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.compute.rpcapi [None req-b9fbc81d-2770-4bf9-aba9-a1f2d6e6a6b6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 24 13:26:11.780890 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b9fbc81d-2770-4bf9-aba9-a1f2d6e6a6b6 None None] Releasing lock "compute-rpcapi-router" {{(pid=119146) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 13:26:11.798001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b9fbc81d-2770-4bf9-aba9-a1f2d6e6a6b6 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.073430 Oct 24 13:26:11.798855 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 75/146] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:26:11.799502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-93847d4d-89c0-45b1-aa23-767a50261f3f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:11.807283 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-93847d4d-89c0-45b1-aa23-767a50261f3f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.170035 Oct 24 13:26:11.807830 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 72/147] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:11 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:12.071894 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-27c06a39-11cc-44e7-b690-c0f89758423d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:12.072641 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-27c06a39-11cc-44e7-b690-c0f89758423d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:12.078776 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-27c06a39-11cc-44e7-b690-c0f89758423d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:12.079248 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-27c06a39-11cc-44e7-b690-c0f89758423d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:12.079674 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-27c06a39-11cc-44e7-b690-c0f89758423d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:12.080441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-27c06a39-11cc-44e7-b690-c0f89758423d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:12.081154 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-27c06a39-11cc-44e7-b690-c0f89758423d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:12.081572 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-27c06a39-11cc-44e7-b690-c0f89758423d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:12.186587 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-10bc6393-a579-4488-9ac2-3f84d89b072f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:12.187550 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-10bc6393-a579-4488-9ac2-3f84d89b072f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:12.193451 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-10bc6393-a579-4488-9ac2-3f84d89b072f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:12.194506 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-10bc6393-a579-4488-9ac2-3f84d89b072f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:12.194992 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-10bc6393-a579-4488-9ac2-3f84d89b072f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:12.195722 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-10bc6393-a579-4488-9ac2-3f84d89b072f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:12.196220 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-10bc6393-a579-4488-9ac2-3f84d89b072f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:12.199275 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-10bc6393-a579-4488-9ac2-3f84d89b072f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:12.214492 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-27c06a39-11cc-44e7-b690-c0f89758423d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:12.223011 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-27c06a39-11cc-44e7-b690-c0f89758423d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.155878 Oct 24 13:26:12.223579 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 76/148] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:12 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:12.323757 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-10bc6393-a579-4488-9ac2-3f84d89b072f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:12.331513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-10bc6393-a579-4488-9ac2-3f84d89b072f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.149185 Oct 24 13:26:12.332074 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 73/149] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:12 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:12.503409 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-395a81ce-da8a-4088-b4c2-7b7a418853a5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:12.504013 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-395a81ce-da8a-4088-b4c2-7b7a418853a5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:12.510473 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-395a81ce-da8a-4088-b4c2-7b7a418853a5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:12.510949 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-395a81ce-da8a-4088-b4c2-7b7a418853a5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:12.511374 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-395a81ce-da8a-4088-b4c2-7b7a418853a5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:12.512047 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-395a81ce-da8a-4088-b4c2-7b7a418853a5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:12.512526 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-395a81ce-da8a-4088-b4c2-7b7a418853a5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:12.512942 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-395a81ce-da8a-4088-b4c2-7b7a418853a5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:12.635859 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-395a81ce-da8a-4088-b4c2-7b7a418853a5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:12.643817 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-395a81ce-da8a-4088-b4c2-7b7a418853a5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:12.645269 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-395a81ce-da8a-4088-b4c2-7b7a418853a5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:12.646361 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-395a81ce-da8a-4088-b4c2-7b7a418853a5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.146803 Oct 24 13:26:12.646915 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 77/150] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:12 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:12.829854 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-bda13935-1d59-49ba-ab45-2111fe9129b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:12.830981 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-bda13935-1d59-49ba-ab45-2111fe9129b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:12.836912 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bda13935-1d59-49ba-ab45-2111fe9129b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:12.837332 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bda13935-1d59-49ba-ab45-2111fe9129b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:12.837758 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bda13935-1d59-49ba-ab45-2111fe9129b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:12.838426 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bda13935-1d59-49ba-ab45-2111fe9129b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:12.838866 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bda13935-1d59-49ba-ab45-2111fe9129b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:12.839277 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bda13935-1d59-49ba-ab45-2111fe9129b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:12.965525 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-bda13935-1d59-49ba-ab45-2111fe9129b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:12.973122 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-bda13935-1d59-49ba-ab45-2111fe9129b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.147050 Oct 24 13:26:12.973692 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 74/151] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:12 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:13.245265 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e792becf-d300-4e76-82cc-73a583b424e8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:13.245967 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e792becf-d300-4e76-82cc-73a583b424e8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:13.251975 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e792becf-d300-4e76-82cc-73a583b424e8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:13.252456 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e792becf-d300-4e76-82cc-73a583b424e8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:13.252882 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e792becf-d300-4e76-82cc-73a583b424e8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:13.253549 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e792becf-d300-4e76-82cc-73a583b424e8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:13.253991 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e792becf-d300-4e76-82cc-73a583b424e8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:13.254435 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e792becf-d300-4e76-82cc-73a583b424e8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:13.361031 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8bbd63c6-00ad-4b32-8836-d761939fb184 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:13.361031 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-8bbd63c6-00ad-4b32-8836-d761939fb184 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:13.361031 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8bbd63c6-00ad-4b32-8836-d761939fb184 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:13.361031 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8bbd63c6-00ad-4b32-8836-d761939fb184 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:13.361814 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8bbd63c6-00ad-4b32-8836-d761939fb184 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:13.362007 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8bbd63c6-00ad-4b32-8836-d761939fb184 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:13.362435 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8bbd63c6-00ad-4b32-8836-d761939fb184 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:13.362849 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8bbd63c6-00ad-4b32-8836-d761939fb184 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:13.380327 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e792becf-d300-4e76-82cc-73a583b424e8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:13.390662 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e792becf-d300-4e76-82cc-73a583b424e8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.149122 Oct 24 13:26:13.391244 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 78/152] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:13 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:13.494441 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-8bbd63c6-00ad-4b32-8836-d761939fb184 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:13.502051 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-8bbd63c6-00ad-4b32-8836-d761939fb184 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.151940 Oct 24 13:26:13.502610 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 75/153] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:13 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:13.671098 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-90bebc91-6812-45fb-abfe-e31ee0efc65a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:13.671706 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-90bebc91-6812-45fb-abfe-e31ee0efc65a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:13.677717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-90bebc91-6812-45fb-abfe-e31ee0efc65a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:13.678193 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-90bebc91-6812-45fb-abfe-e31ee0efc65a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:13.678620 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-90bebc91-6812-45fb-abfe-e31ee0efc65a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:13.679294 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-90bebc91-6812-45fb-abfe-e31ee0efc65a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:13.679737 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-90bebc91-6812-45fb-abfe-e31ee0efc65a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:13.680151 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-90bebc91-6812-45fb-abfe-e31ee0efc65a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:13.811047 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-90bebc91-6812-45fb-abfe-e31ee0efc65a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:13.819859 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-90bebc91-6812-45fb-abfe-e31ee0efc65a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:13.821472 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-90bebc91-6812-45fb-abfe-e31ee0efc65a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:13.822577 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-90bebc91-6812-45fb-abfe-e31ee0efc65a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.155458 Oct 24 13:26:13.823299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 79/154] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:13 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:13.995715 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b7fc3ec0-0db3-4e75-8726-9fbd6dfe3176 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:13.996245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b7fc3ec0-0db3-4e75-8726-9fbd6dfe3176 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:14.002230 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b7fc3ec0-0db3-4e75-8726-9fbd6dfe3176 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:14.002704 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b7fc3ec0-0db3-4e75-8726-9fbd6dfe3176 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:14.003124 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b7fc3ec0-0db3-4e75-8726-9fbd6dfe3176 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:14.003790 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b7fc3ec0-0db3-4e75-8726-9fbd6dfe3176 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:14.004234 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b7fc3ec0-0db3-4e75-8726-9fbd6dfe3176 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:14.004715 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b7fc3ec0-0db3-4e75-8726-9fbd6dfe3176 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:14.135762 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b7fc3ec0-0db3-4e75-8726-9fbd6dfe3176 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:14.143717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b7fc3ec0-0db3-4e75-8726-9fbd6dfe3176 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.151898 Oct 24 13:26:14.144300 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 76/155] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:13 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:14.415012 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-870c8852-5c64-405b-a9c9-9d92b1737ae5 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:14.415649 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-870c8852-5c64-405b-a9c9-9d92b1737ae5 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:14.421805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-870c8852-5c64-405b-a9c9-9d92b1737ae5 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:14.422352 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-870c8852-5c64-405b-a9c9-9d92b1737ae5 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:14.422797 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-870c8852-5c64-405b-a9c9-9d92b1737ae5 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:14.423606 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-870c8852-5c64-405b-a9c9-9d92b1737ae5 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:14.424055 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-870c8852-5c64-405b-a9c9-9d92b1737ae5 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:14.424542 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-870c8852-5c64-405b-a9c9-9d92b1737ae5 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:14.526701 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-341d0832-6c84-4cb3-a467-7f1178436859 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:14.527321 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-341d0832-6c84-4cb3-a467-7f1178436859 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:14.533148 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-341d0832-6c84-4cb3-a467-7f1178436859 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:14.533656 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-341d0832-6c84-4cb3-a467-7f1178436859 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:14.534105 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-341d0832-6c84-4cb3-a467-7f1178436859 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:14.534784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-341d0832-6c84-4cb3-a467-7f1178436859 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:14.535226 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-341d0832-6c84-4cb3-a467-7f1178436859 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:14.535641 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-341d0832-6c84-4cb3-a467-7f1178436859 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:14.551278 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-870c8852-5c64-405b-a9c9-9d92b1737ae5 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:14.559374 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-870c8852-5c64-405b-a9c9-9d92b1737ae5 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.148898 Oct 24 13:26:14.560305 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 80/156] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:14 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:14.667486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-341d0832-6c84-4cb3-a467-7f1178436859 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:14.675386 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-341d0832-6c84-4cb3-a467-7f1178436859 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.153631 Oct 24 13:26:14.675962 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 77/157] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:14 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:14.847004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-549fe584-5883-44f8-a6fa-9dc1d7edefbc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:14.847516 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-549fe584-5883-44f8-a6fa-9dc1d7edefbc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:14.853410 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-549fe584-5883-44f8-a6fa-9dc1d7edefbc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:14.853881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-549fe584-5883-44f8-a6fa-9dc1d7edefbc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:14.854309 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-549fe584-5883-44f8-a6fa-9dc1d7edefbc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:14.854979 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-549fe584-5883-44f8-a6fa-9dc1d7edefbc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:14.855421 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-549fe584-5883-44f8-a6fa-9dc1d7edefbc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:14.855833 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-549fe584-5883-44f8-a6fa-9dc1d7edefbc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:14.983410 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-549fe584-5883-44f8-a6fa-9dc1d7edefbc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:14.991710 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-549fe584-5883-44f8-a6fa-9dc1d7edefbc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:14.993160 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-549fe584-5883-44f8-a6fa-9dc1d7edefbc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:14.994301 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-549fe584-5883-44f8-a6fa-9dc1d7edefbc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.151239 Oct 24 13:26:14.994846 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 81/158] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:14 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:15.165946 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c318827f-7201-4945-9782-13ecd10c1fb6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:15.166579 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-c318827f-7201-4945-9782-13ecd10c1fb6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:15.172423 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c318827f-7201-4945-9782-13ecd10c1fb6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:15.172890 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c318827f-7201-4945-9782-13ecd10c1fb6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:15.173305 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c318827f-7201-4945-9782-13ecd10c1fb6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:15.173967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c318827f-7201-4945-9782-13ecd10c1fb6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:15.174402 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c318827f-7201-4945-9782-13ecd10c1fb6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:15.174806 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c318827f-7201-4945-9782-13ecd10c1fb6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:15.298481 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c318827f-7201-4945-9782-13ecd10c1fb6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:15.306391 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-c318827f-7201-4945-9782-13ecd10c1fb6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.144208 Oct 24 13:26:15.306946 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 78/159] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:15 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:15.584031 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5516599e-6740-4ef8-9aa8-15ff0bf54b8a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:15.584786 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5516599e-6740-4ef8-9aa8-15ff0bf54b8a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:15.590950 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5516599e-6740-4ef8-9aa8-15ff0bf54b8a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:15.591563 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5516599e-6740-4ef8-9aa8-15ff0bf54b8a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:15.591981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5516599e-6740-4ef8-9aa8-15ff0bf54b8a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:15.592611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5516599e-6740-4ef8-9aa8-15ff0bf54b8a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:15.593058 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5516599e-6740-4ef8-9aa8-15ff0bf54b8a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:15.593474 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5516599e-6740-4ef8-9aa8-15ff0bf54b8a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:15.698367 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a057df1a-5f8e-419d-be64-1fde412a0152 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:15.699006 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a057df1a-5f8e-419d-be64-1fde412a0152 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:15.705055 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a057df1a-5f8e-419d-be64-1fde412a0152 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:15.709374 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a057df1a-5f8e-419d-be64-1fde412a0152 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:15.709374 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a057df1a-5f8e-419d-be64-1fde412a0152 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:15.709374 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a057df1a-5f8e-419d-be64-1fde412a0152 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:15.709374 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a057df1a-5f8e-419d-be64-1fde412a0152 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:15.709725 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a057df1a-5f8e-419d-be64-1fde412a0152 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:15.722175 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5516599e-6740-4ef8-9aa8-15ff0bf54b8a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:15.730317 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5516599e-6740-4ef8-9aa8-15ff0bf54b8a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.150382 Oct 24 13:26:15.733890 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 82/160] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:15 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:15.838188 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a057df1a-5f8e-419d-be64-1fde412a0152 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:15.846360 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a057df1a-5f8e-419d-be64-1fde412a0152 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.151911 Oct 24 13:26:15.846943 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 79/161] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:15 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:16.019015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-31eb2abc-c628-4553-815d-748679f56b4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:16.019620 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-31eb2abc-c628-4553-815d-748679f56b4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:16.026008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31eb2abc-c628-4553-815d-748679f56b4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:16.026479 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31eb2abc-c628-4553-815d-748679f56b4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:16.026902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31eb2abc-c628-4553-815d-748679f56b4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:16.027570 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31eb2abc-c628-4553-815d-748679f56b4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:16.028013 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31eb2abc-c628-4553-815d-748679f56b4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:16.028473 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31eb2abc-c628-4553-815d-748679f56b4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:16.155328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-31eb2abc-c628-4553-815d-748679f56b4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:16.164005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-31eb2abc-c628-4553-815d-748679f56b4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:16.165569 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-31eb2abc-c628-4553-815d-748679f56b4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:16.166800 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-31eb2abc-c628-4553-815d-748679f56b4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.151618 Oct 24 13:26:16.167351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 83/162] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:16 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:16.329260 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c89230b1-8457-420b-a169-0fcce5499c0a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:16.329862 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-c89230b1-8457-420b-a169-0fcce5499c0a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:16.336626 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c89230b1-8457-420b-a169-0fcce5499c0a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:16.337091 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c89230b1-8457-420b-a169-0fcce5499c0a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:16.337511 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c89230b1-8457-420b-a169-0fcce5499c0a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:16.338171 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c89230b1-8457-420b-a169-0fcce5499c0a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:16.338608 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c89230b1-8457-420b-a169-0fcce5499c0a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:16.339011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c89230b1-8457-420b-a169-0fcce5499c0a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:16.463570 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c89230b1-8457-420b-a169-0fcce5499c0a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:16.471056 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-c89230b1-8457-420b-a169-0fcce5499c0a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.145591 Oct 24 13:26:16.471609 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 80/163] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:16 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:16.753506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-dd76f5bf-1d03-4d56-aadf-2d84db7500c8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:16.754110 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-dd76f5bf-1d03-4d56-aadf-2d84db7500c8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:16.760808 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dd76f5bf-1d03-4d56-aadf-2d84db7500c8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:16.761284 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dd76f5bf-1d03-4d56-aadf-2d84db7500c8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:16.761711 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dd76f5bf-1d03-4d56-aadf-2d84db7500c8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:16.762384 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dd76f5bf-1d03-4d56-aadf-2d84db7500c8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:16.762842 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dd76f5bf-1d03-4d56-aadf-2d84db7500c8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:16.763242 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dd76f5bf-1d03-4d56-aadf-2d84db7500c8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:16.870216 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-de46087d-28b6-4e6c-aa59-27f6c93242f5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:16.870766 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-de46087d-28b6-4e6c-aa59-27f6c93242f5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:16.876543 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-de46087d-28b6-4e6c-aa59-27f6c93242f5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:16.877011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-de46087d-28b6-4e6c-aa59-27f6c93242f5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:16.877430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-de46087d-28b6-4e6c-aa59-27f6c93242f5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:16.878096 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-de46087d-28b6-4e6c-aa59-27f6c93242f5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:16.878532 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-de46087d-28b6-4e6c-aa59-27f6c93242f5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:16.878944 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-de46087d-28b6-4e6c-aa59-27f6c93242f5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:16.893876 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-dd76f5bf-1d03-4d56-aadf-2d84db7500c8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:16.901530 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-dd76f5bf-1d03-4d56-aadf-2d84db7500c8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.151783 Oct 24 13:26:16.902097 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 84/164] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:16 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:17.005632 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-de46087d-28b6-4e6c-aa59-27f6c93242f5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:17.013976 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-de46087d-28b6-4e6c-aa59-27f6c93242f5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.148199 Oct 24 13:26:17.014550 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 81/165] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:16 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:17.190729 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-6ea2733d-ae82-47a8-a99f-867d49a93ef4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:17.191320 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-6ea2733d-ae82-47a8-a99f-867d49a93ef4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:17.197193 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6ea2733d-ae82-47a8-a99f-867d49a93ef4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:17.197664 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6ea2733d-ae82-47a8-a99f-867d49a93ef4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:17.198084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6ea2733d-ae82-47a8-a99f-867d49a93ef4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:17.198755 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6ea2733d-ae82-47a8-a99f-867d49a93ef4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:17.199193 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6ea2733d-ae82-47a8-a99f-867d49a93ef4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:17.199604 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6ea2733d-ae82-47a8-a99f-867d49a93ef4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:17.324492 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6ea2733d-ae82-47a8-a99f-867d49a93ef4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:17.332652 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6ea2733d-ae82-47a8-a99f-867d49a93ef4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:17.334055 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6ea2733d-ae82-47a8-a99f-867d49a93ef4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:17.335173 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-6ea2733d-ae82-47a8-a99f-867d49a93ef4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.148274 Oct 24 13:26:17.335722 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 85/166] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:17 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:17.493005 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-545b8172-aef6-46ca-92bd-919a1c1716e2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:17.493610 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-545b8172-aef6-46ca-92bd-919a1c1716e2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:17.499399 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-545b8172-aef6-46ca-92bd-919a1c1716e2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:17.499870 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-545b8172-aef6-46ca-92bd-919a1c1716e2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:17.500318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-545b8172-aef6-46ca-92bd-919a1c1716e2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:17.500989 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-545b8172-aef6-46ca-92bd-919a1c1716e2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:17.501437 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-545b8172-aef6-46ca-92bd-919a1c1716e2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:17.501845 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-545b8172-aef6-46ca-92bd-919a1c1716e2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:17.628733 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-545b8172-aef6-46ca-92bd-919a1c1716e2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:17.636190 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-545b8172-aef6-46ca-92bd-919a1c1716e2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.147145 Oct 24 13:26:17.636771 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 82/167] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:17 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:17.924104 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9854470a-c578-4983-98cf-d050939a1ea8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:17.924759 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-9854470a-c578-4983-98cf-d050939a1ea8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:17.927816 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=100 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:17.931177 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9854470a-c578-4983-98cf-d050939a1ea8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:17.931651 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9854470a-c578-4983-98cf-d050939a1ea8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:17.932121 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9854470a-c578-4983-98cf-d050939a1ea8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:17.932861 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9854470a-c578-4983-98cf-d050939a1ea8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:17.933289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9854470a-c578-4983-98cf-d050939a1ea8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:17.933708 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9854470a-c578-4983-98cf-d050939a1ea8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:18.037074 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-cee1c8ae-6e70-4f80-b6e5-fb9a2f8e118f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:18.037968 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-cee1c8ae-6e70-4f80-b6e5-fb9a2f8e118f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:18.044152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cee1c8ae-6e70-4f80-b6e5-fb9a2f8e118f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:18.044732 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cee1c8ae-6e70-4f80-b6e5-fb9a2f8e118f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:18.045282 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cee1c8ae-6e70-4f80-b6e5-fb9a2f8e118f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:18.046028 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cee1c8ae-6e70-4f80-b6e5-fb9a2f8e118f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:18.046537 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cee1c8ae-6e70-4f80-b6e5-fb9a2f8e118f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:18.047026 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cee1c8ae-6e70-4f80-b6e5-fb9a2f8e118f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:18.064961 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-9854470a-c578-4983-98cf-d050939a1ea8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:18.075438 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9854470a-c578-4983-98cf-d050939a1ea8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.155123 Oct 24 13:26:18.085510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 86/168] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:17 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:18.176345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-cee1c8ae-6e70-4f80-b6e5-fb9a2f8e118f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:18.184032 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-cee1c8ae-6e70-4f80-b6e5-fb9a2f8e118f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.150944 Oct 24 13:26:18.184629 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 83/169] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:18 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:18.360338 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-d069eb37-07e9-4758-b2dd-2ef5ec5b67c8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:18.360953 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-d069eb37-07e9-4758-b2dd-2ef5ec5b67c8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:18.367447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d069eb37-07e9-4758-b2dd-2ef5ec5b67c8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:18.367927 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d069eb37-07e9-4758-b2dd-2ef5ec5b67c8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:18.368388 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d069eb37-07e9-4758-b2dd-2ef5ec5b67c8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:18.369073 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d069eb37-07e9-4758-b2dd-2ef5ec5b67c8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:18.369525 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d069eb37-07e9-4758-b2dd-2ef5ec5b67c8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:18.369952 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d069eb37-07e9-4758-b2dd-2ef5ec5b67c8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:18.494093 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-d069eb37-07e9-4758-b2dd-2ef5ec5b67c8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:18.502350 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-d069eb37-07e9-4758-b2dd-2ef5ec5b67c8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:18.503948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-d069eb37-07e9-4758-b2dd-2ef5ec5b67c8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:18.505078 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-d069eb37-07e9-4758-b2dd-2ef5ec5b67c8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.148679 Oct 24 13:26:18.505656 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 87/170] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:18 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:18.659123 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f28f639b-88bb-4449-b4d1-fff9fda28667 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:18.659723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f28f639b-88bb-4449-b4d1-fff9fda28667 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:18.665649 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f28f639b-88bb-4449-b4d1-fff9fda28667 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:18.666119 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f28f639b-88bb-4449-b4d1-fff9fda28667 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:18.666543 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f28f639b-88bb-4449-b4d1-fff9fda28667 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:18.667210 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f28f639b-88bb-4449-b4d1-fff9fda28667 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:18.667683 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f28f639b-88bb-4449-b4d1-fff9fda28667 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:18.668096 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f28f639b-88bb-4449-b4d1-fff9fda28667 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:18.798034 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f28f639b-88bb-4449-b4d1-fff9fda28667 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:18.805699 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f28f639b-88bb-4449-b4d1-fff9fda28667 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.150309 Oct 24 13:26:18.806301 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 84/171] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:18 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:19.099468 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b85ff09f-4441-4fda-a553-094097011a51 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:19.100105 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b85ff09f-4441-4fda-a553-094097011a51 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:19.106374 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b85ff09f-4441-4fda-a553-094097011a51 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:19.106855 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b85ff09f-4441-4fda-a553-094097011a51 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:19.107287 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b85ff09f-4441-4fda-a553-094097011a51 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:19.108000 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b85ff09f-4441-4fda-a553-094097011a51 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:19.108477 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b85ff09f-4441-4fda-a553-094097011a51 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:19.109161 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b85ff09f-4441-4fda-a553-094097011a51 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:19.207052 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-72b27f56-d2ae-4465-94b1-b293c1169904 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:19.207787 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-72b27f56-d2ae-4465-94b1-b293c1169904 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:19.213607 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-72b27f56-d2ae-4465-94b1-b293c1169904 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:19.214085 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-72b27f56-d2ae-4465-94b1-b293c1169904 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:19.214511 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-72b27f56-d2ae-4465-94b1-b293c1169904 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:19.215217 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-72b27f56-d2ae-4465-94b1-b293c1169904 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:19.215663 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-72b27f56-d2ae-4465-94b1-b293c1169904 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:19.216082 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-72b27f56-d2ae-4465-94b1-b293c1169904 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:19.237824 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b85ff09f-4441-4fda-a553-094097011a51 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:19.245976 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b85ff09f-4441-4fda-a553-094097011a51 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.150359 Oct 24 13:26:19.247349 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 88/172] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:19 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:19.345532 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-72b27f56-d2ae-4465-94b1-b293c1169904 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:19.353445 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-72b27f56-d2ae-4465-94b1-b293c1169904 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.150497 Oct 24 13:26:19.354001 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 85/173] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:19 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:19.530221 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-252d6827-289d-4f2c-8642-ca606a797b0f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:19.530824 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-252d6827-289d-4f2c-8642-ca606a797b0f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:19.536620 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-252d6827-289d-4f2c-8642-ca606a797b0f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:19.537093 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-252d6827-289d-4f2c-8642-ca606a797b0f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:19.538027 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-252d6827-289d-4f2c-8642-ca606a797b0f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:19.538701 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-252d6827-289d-4f2c-8642-ca606a797b0f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:19.539142 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-252d6827-289d-4f2c-8642-ca606a797b0f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:19.539589 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-252d6827-289d-4f2c-8642-ca606a797b0f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:19.662411 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-252d6827-289d-4f2c-8642-ca606a797b0f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:19.670941 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-252d6827-289d-4f2c-8642-ca606a797b0f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:19.672394 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-252d6827-289d-4f2c-8642-ca606a797b0f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:19.673486 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-252d6827-289d-4f2c-8642-ca606a797b0f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.147099 Oct 24 13:26:19.674035 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 89/174] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:19 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:19.828395 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7c25aeab-aff7-4791-b75c-f210afae4430 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:19.829002 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-7c25aeab-aff7-4791-b75c-f210afae4430 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:19.835678 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7c25aeab-aff7-4791-b75c-f210afae4430 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:19.836145 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7c25aeab-aff7-4791-b75c-f210afae4430 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:19.836597 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7c25aeab-aff7-4791-b75c-f210afae4430 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:19.837269 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7c25aeab-aff7-4791-b75c-f210afae4430 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:19.837709 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7c25aeab-aff7-4791-b75c-f210afae4430 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:19.838121 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7c25aeab-aff7-4791-b75c-f210afae4430 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:19.968442 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-7c25aeab-aff7-4791-b75c-f210afae4430 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:19.976676 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-7c25aeab-aff7-4791-b75c-f210afae4430 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.152020 Oct 24 13:26:19.977238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 86/175] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:19 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:20.268366 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3ceb3fe1-cd82-4825-9f94-a859b5a2fc4b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:20.268979 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-3ceb3fe1-cd82-4825-9f94-a859b5a2fc4b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:20.275498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3ceb3fe1-cd82-4825-9f94-a859b5a2fc4b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:20.275979 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3ceb3fe1-cd82-4825-9f94-a859b5a2fc4b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:20.276434 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3ceb3fe1-cd82-4825-9f94-a859b5a2fc4b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:20.277112 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3ceb3fe1-cd82-4825-9f94-a859b5a2fc4b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:20.277555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3ceb3fe1-cd82-4825-9f94-a859b5a2fc4b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:20.277967 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3ceb3fe1-cd82-4825-9f94-a859b5a2fc4b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:20.376604 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-86648655-2e14-43dc-969b-4d7c56eaacb3 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:20.377211 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-86648655-2e14-43dc-969b-4d7c56eaacb3 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:20.380086 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=100 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:20.383876 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-86648655-2e14-43dc-969b-4d7c56eaacb3 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:20.384373 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-86648655-2e14-43dc-969b-4d7c56eaacb3 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:20.384979 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-86648655-2e14-43dc-969b-4d7c56eaacb3 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:20.391235 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-86648655-2e14-43dc-969b-4d7c56eaacb3 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:20.391235 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-86648655-2e14-43dc-969b-4d7c56eaacb3 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:20.391235 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-86648655-2e14-43dc-969b-4d7c56eaacb3 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:20.402848 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3ceb3fe1-cd82-4825-9f94-a859b5a2fc4b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:20.410528 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3ceb3fe1-cd82-4825-9f94-a859b5a2fc4b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.145944 Oct 24 13:26:20.411099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 90/176] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:20 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:20.512866 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-86648655-2e14-43dc-969b-4d7c56eaacb3 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:20.520301 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-86648655-2e14-43dc-969b-4d7c56eaacb3 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.147431 Oct 24 13:26:20.520860 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 87/177] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:20 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:20.699320 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-82a99cc7-6757-461b-87fb-57e4892f1a76 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:20.699925 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-82a99cc7-6757-461b-87fb-57e4892f1a76 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:20.706182 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-82a99cc7-6757-461b-87fb-57e4892f1a76 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:20.706653 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-82a99cc7-6757-461b-87fb-57e4892f1a76 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:20.707098 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-82a99cc7-6757-461b-87fb-57e4892f1a76 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:20.707792 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-82a99cc7-6757-461b-87fb-57e4892f1a76 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:20.708232 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-82a99cc7-6757-461b-87fb-57e4892f1a76 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:20.708693 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-82a99cc7-6757-461b-87fb-57e4892f1a76 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:20.838027 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-82a99cc7-6757-461b-87fb-57e4892f1a76 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:20.841477 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=100 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:20.846302 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-82a99cc7-6757-461b-87fb-57e4892f1a76 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:20.847739 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-82a99cc7-6757-461b-87fb-57e4892f1a76 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:20.848874 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-82a99cc7-6757-461b-87fb-57e4892f1a76 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.153451 Oct 24 13:26:20.849431 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 91/178] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:20 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:20.998832 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-83dc9a12-cdf3-4d9c-a955-84927731fbc4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:20.999367 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-83dc9a12-cdf3-4d9c-a955-84927731fbc4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:21.005313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-83dc9a12-cdf3-4d9c-a955-84927731fbc4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:21.005812 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-83dc9a12-cdf3-4d9c-a955-84927731fbc4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:21.006249 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-83dc9a12-cdf3-4d9c-a955-84927731fbc4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:21.006919 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-83dc9a12-cdf3-4d9c-a955-84927731fbc4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:21.007357 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-83dc9a12-cdf3-4d9c-a955-84927731fbc4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:21.007770 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-83dc9a12-cdf3-4d9c-a955-84927731fbc4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:21.026374 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=100 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:21.136291 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-83dc9a12-cdf3-4d9c-a955-84927731fbc4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:21.144224 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-83dc9a12-cdf3-4d9c-a955-84927731fbc4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.149226 Oct 24 13:26:21.144828 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 88/179] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:20 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:21.433144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-598e94b3-8ec1-4a6a-a399-785e260ca9c8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:21.433928 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-598e94b3-8ec1-4a6a-a399-785e260ca9c8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:21.440045 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-598e94b3-8ec1-4a6a-a399-785e260ca9c8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:21.440542 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-598e94b3-8ec1-4a6a-a399-785e260ca9c8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:21.440969 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-598e94b3-8ec1-4a6a-a399-785e260ca9c8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:21.441642 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-598e94b3-8ec1-4a6a-a399-785e260ca9c8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:21.442084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-598e94b3-8ec1-4a6a-a399-785e260ca9c8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:21.442497 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-598e94b3-8ec1-4a6a-a399-785e260ca9c8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:21.543280 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-52799670-c35c-4da9-a54a-ca82311e94f4 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:21.543882 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-52799670-c35c-4da9-a54a-ca82311e94f4 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:21.549689 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-52799670-c35c-4da9-a54a-ca82311e94f4 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:21.550151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-52799670-c35c-4da9-a54a-ca82311e94f4 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:21.550567 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-52799670-c35c-4da9-a54a-ca82311e94f4 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:21.551229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-52799670-c35c-4da9-a54a-ca82311e94f4 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:21.551663 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-52799670-c35c-4da9-a54a-ca82311e94f4 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:21.552070 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-52799670-c35c-4da9-a54a-ca82311e94f4 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:21.568630 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-598e94b3-8ec1-4a6a-a399-785e260ca9c8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:21.576612 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-598e94b3-8ec1-4a6a-a399-785e260ca9c8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.147267 Oct 24 13:26:21.577169 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 92/180] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:21 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:21.682232 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-52799670-c35c-4da9-a54a-ca82311e94f4 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:21.690210 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-52799670-c35c-4da9-a54a-ca82311e94f4 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.150561 Oct 24 13:26:21.690788 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 89/181] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:21 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:21.874595 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8a624404-0d19-40ac-a539-875c7912b5fd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:21.875218 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8a624404-0d19-40ac-a539-875c7912b5fd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:21.877045 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=2 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:21.882267 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8a624404-0d19-40ac-a539-875c7912b5fd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:21.882740 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8a624404-0d19-40ac-a539-875c7912b5fd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:21.883169 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8a624404-0d19-40ac-a539-875c7912b5fd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:21.883847 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8a624404-0d19-40ac-a539-875c7912b5fd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:21.884861 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8a624404-0d19-40ac-a539-875c7912b5fd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:21.884861 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8a624404-0d19-40ac-a539-875c7912b5fd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:22.013473 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8a624404-0d19-40ac-a539-875c7912b5fd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:22.021591 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8a624404-0d19-40ac-a539-875c7912b5fd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:22.022966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8a624404-0d19-40ac-a539-875c7912b5fd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:22.024093 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8a624404-0d19-40ac-a539-875c7912b5fd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.153350 Oct 24 13:26:22.024683 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 93/182] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:21 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:22.166787 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8f1cd365-1a9f-4304-b5c5-d619b4c66593 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:22.167387 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-8f1cd365-1a9f-4304-b5c5-d619b4c66593 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:22.173261 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8f1cd365-1a9f-4304-b5c5-d619b4c66593 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:22.173729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8f1cd365-1a9f-4304-b5c5-d619b4c66593 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:22.174151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8f1cd365-1a9f-4304-b5c5-d619b4c66593 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:22.174816 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8f1cd365-1a9f-4304-b5c5-d619b4c66593 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:22.175256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8f1cd365-1a9f-4304-b5c5-d619b4c66593 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:22.175668 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8f1cd365-1a9f-4304-b5c5-d619b4c66593 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:22.301113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-8f1cd365-1a9f-4304-b5c5-d619b4c66593 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:22.309457 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-8f1cd365-1a9f-4304-b5c5-d619b4c66593 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.146473 Oct 24 13:26:22.310014 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 90/183] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:22 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:22.599836 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-4fc596f3-0cbb-4193-955e-a637d2d38ebe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:22.600387 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-4fc596f3-0cbb-4193-955e-a637d2d38ebe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:22.606218 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4fc596f3-0cbb-4193-955e-a637d2d38ebe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:22.606778 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4fc596f3-0cbb-4193-955e-a637d2d38ebe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:22.607200 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4fc596f3-0cbb-4193-955e-a637d2d38ebe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:22.607868 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4fc596f3-0cbb-4193-955e-a637d2d38ebe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:22.608346 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4fc596f3-0cbb-4193-955e-a637d2d38ebe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:22.608789 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4fc596f3-0cbb-4193-955e-a637d2d38ebe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:22.714702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-daf6bf39-eae2-4fc6-a56b-c85493ec3483 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:22.715897 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-daf6bf39-eae2-4fc6-a56b-c85493ec3483 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:22.721823 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-daf6bf39-eae2-4fc6-a56b-c85493ec3483 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:22.722308 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-daf6bf39-eae2-4fc6-a56b-c85493ec3483 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:22.722732 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-daf6bf39-eae2-4fc6-a56b-c85493ec3483 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:22.723419 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-daf6bf39-eae2-4fc6-a56b-c85493ec3483 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:22.723867 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-daf6bf39-eae2-4fc6-a56b-c85493ec3483 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:22.724301 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-daf6bf39-eae2-4fc6-a56b-c85493ec3483 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:22.735050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-4fc596f3-0cbb-4193-955e-a637d2d38ebe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:22.743862 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-4fc596f3-0cbb-4193-955e-a637d2d38ebe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.147918 Oct 24 13:26:22.744537 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 94/184] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:22 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:22.856844 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-daf6bf39-eae2-4fc6-a56b-c85493ec3483 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:22.864435 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-daf6bf39-eae2-4fc6-a56b-c85493ec3483 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.154627 Oct 24 13:26:22.864997 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 91/185] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:22 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:23.048205 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-6aaaf4b9-68ef-4048-a9fe-ca11f7e9769b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:23.048843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-6aaaf4b9-68ef-4048-a9fe-ca11f7e9769b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:23.055235 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6aaaf4b9-68ef-4048-a9fe-ca11f7e9769b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:23.055735 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6aaaf4b9-68ef-4048-a9fe-ca11f7e9769b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:23.056159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6aaaf4b9-68ef-4048-a9fe-ca11f7e9769b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:23.056870 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6aaaf4b9-68ef-4048-a9fe-ca11f7e9769b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:23.057312 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6aaaf4b9-68ef-4048-a9fe-ca11f7e9769b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:23.057723 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6aaaf4b9-68ef-4048-a9fe-ca11f7e9769b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:23.184111 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6aaaf4b9-68ef-4048-a9fe-ca11f7e9769b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:23.192163 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6aaaf4b9-68ef-4048-a9fe-ca11f7e9769b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:23.193621 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6aaaf4b9-68ef-4048-a9fe-ca11f7e9769b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:23.194716 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-6aaaf4b9-68ef-4048-a9fe-ca11f7e9769b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.150402 Oct 24 13:26:23.195259 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 95/186] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:23 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:23.332705 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c9da5b9c-a429-460c-8cf7-aa67643a88fa tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:23.333308 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-c9da5b9c-a429-460c-8cf7-aa67643a88fa tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:23.339303 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c9da5b9c-a429-460c-8cf7-aa67643a88fa tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:23.339781 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c9da5b9c-a429-460c-8cf7-aa67643a88fa tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:23.340208 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c9da5b9c-a429-460c-8cf7-aa67643a88fa tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:23.341921 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c9da5b9c-a429-460c-8cf7-aa67643a88fa tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:23.341921 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c9da5b9c-a429-460c-8cf7-aa67643a88fa tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:23.341921 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c9da5b9c-a429-460c-8cf7-aa67643a88fa tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:23.482183 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c9da5b9c-a429-460c-8cf7-aa67643a88fa tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:23.489733 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-c9da5b9c-a429-460c-8cf7-aa67643a88fa tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.161114 Oct 24 13:26:23.490300 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 92/187] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:23 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:23.766882 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-568decf3-0860-47db-9a85-4c337891fa9e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:23.767516 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-568decf3-0860-47db-9a85-4c337891fa9e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:23.773594 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-568decf3-0860-47db-9a85-4c337891fa9e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:23.774075 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-568decf3-0860-47db-9a85-4c337891fa9e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:23.774503 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-568decf3-0860-47db-9a85-4c337891fa9e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:23.775181 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-568decf3-0860-47db-9a85-4c337891fa9e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:23.775629 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-568decf3-0860-47db-9a85-4c337891fa9e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:23.776071 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-568decf3-0860-47db-9a85-4c337891fa9e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:23.889477 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e11c4952-1f58-4e89-9dbc-2444d7752435 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:23.891576 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e11c4952-1f58-4e89-9dbc-2444d7752435 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:23.898260 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e11c4952-1f58-4e89-9dbc-2444d7752435 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:23.899080 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e11c4952-1f58-4e89-9dbc-2444d7752435 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:23.899497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e11c4952-1f58-4e89-9dbc-2444d7752435 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:23.900188 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e11c4952-1f58-4e89-9dbc-2444d7752435 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:23.900688 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e11c4952-1f58-4e89-9dbc-2444d7752435 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:23.901101 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e11c4952-1f58-4e89-9dbc-2444d7752435 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:24.045532 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e11c4952-1f58-4e89-9dbc-2444d7752435 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:24.053294 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e11c4952-1f58-4e89-9dbc-2444d7752435 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.167779 Oct 24 13:26:24.054442 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 93/188] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:23 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:24.062920 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-568decf3-0860-47db-9a85-4c337891fa9e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:24.071222 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-568decf3-0860-47db-9a85-4c337891fa9e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.308107 Oct 24 13:26:24.071777 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 96/189] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:23 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:24.219794 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e36d3544-0e52-4787-ba27-b90f53e72fd1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:24.220420 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e36d3544-0e52-4787-ba27-b90f53e72fd1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:24.226955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e36d3544-0e52-4787-ba27-b90f53e72fd1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:24.227425 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e36d3544-0e52-4787-ba27-b90f53e72fd1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:24.227850 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e36d3544-0e52-4787-ba27-b90f53e72fd1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:24.228592 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e36d3544-0e52-4787-ba27-b90f53e72fd1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:24.229035 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e36d3544-0e52-4787-ba27-b90f53e72fd1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:24.229446 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e36d3544-0e52-4787-ba27-b90f53e72fd1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:24.357989 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e36d3544-0e52-4787-ba27-b90f53e72fd1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:24.366289 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e36d3544-0e52-4787-ba27-b90f53e72fd1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:24.367719 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e36d3544-0e52-4787-ba27-b90f53e72fd1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:24.368854 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e36d3544-0e52-4787-ba27-b90f53e72fd1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.152913 Oct 24 13:26:24.369419 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 94/190] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:24 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:24.514418 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5f71c453-e57c-41cb-99f6-4c04d3e75758 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:24.515022 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5f71c453-e57c-41cb-99f6-4c04d3e75758 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:24.520876 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5f71c453-e57c-41cb-99f6-4c04d3e75758 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:24.521361 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5f71c453-e57c-41cb-99f6-4c04d3e75758 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:24.521791 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5f71c453-e57c-41cb-99f6-4c04d3e75758 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:24.522981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5f71c453-e57c-41cb-99f6-4c04d3e75758 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:24.523427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5f71c453-e57c-41cb-99f6-4c04d3e75758 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:24.523875 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5f71c453-e57c-41cb-99f6-4c04d3e75758 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:24.656594 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5f71c453-e57c-41cb-99f6-4c04d3e75758 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:24.665099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5f71c453-e57c-41cb-99f6-4c04d3e75758 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.154469 Oct 24 13:26:24.665954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 97/191] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:24 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:25.077049 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-1dac6232-b73b-4aa1-a31d-9577d4089934 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:25.077651 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-1dac6232-b73b-4aa1-a31d-9577d4089934 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:25.095071 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a4690f92-1efd-4194-b266-42135a77c17a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:25.096243 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a4690f92-1efd-4194-b266-42135a77c17a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:25.110223 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a4690f92-1efd-4194-b266-42135a77c17a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:25.110713 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a4690f92-1efd-4194-b266-42135a77c17a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:25.111012 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1dac6232-b73b-4aa1-a31d-9577d4089934 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:25.111732 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1dac6232-b73b-4aa1-a31d-9577d4089934 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:25.112348 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1dac6232-b73b-4aa1-a31d-9577d4089934 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:25.113199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1dac6232-b73b-4aa1-a31d-9577d4089934 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:25.114344 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1dac6232-b73b-4aa1-a31d-9577d4089934 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:25.114538 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a4690f92-1efd-4194-b266-42135a77c17a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:25.115564 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1dac6232-b73b-4aa1-a31d-9577d4089934 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:25.116288 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a4690f92-1efd-4194-b266-42135a77c17a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:25.120858 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a4690f92-1efd-4194-b266-42135a77c17a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:25.123685 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a4690f92-1efd-4194-b266-42135a77c17a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:25.299976 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a4690f92-1efd-4194-b266-42135a77c17a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:25.309971 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a4690f92-1efd-4194-b266-42135a77c17a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.219455 Oct 24 13:26:25.319052 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 98/192] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:25 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:25.413796 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-79210ec7-c870-407e-a9c0-19a5af3829d2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:25.414720 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-79210ec7-c870-407e-a9c0-19a5af3829d2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:25.421213 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-79210ec7-c870-407e-a9c0-19a5af3829d2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:25.422224 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-79210ec7-c870-407e-a9c0-19a5af3829d2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:25.423074 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-79210ec7-c870-407e-a9c0-19a5af3829d2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:25.424393 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-79210ec7-c870-407e-a9c0-19a5af3829d2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:25.425034 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-79210ec7-c870-407e-a9c0-19a5af3829d2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:25.425722 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-79210ec7-c870-407e-a9c0-19a5af3829d2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:25.716958 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-79210ec7-c870-407e-a9c0-19a5af3829d2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:25.750277 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-79210ec7-c870-407e-a9c0-19a5af3829d2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:25.755959 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-79210ec7-c870-407e-a9c0-19a5af3829d2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:25.761688 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-79210ec7-c870-407e-a9c0-19a5af3829d2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.351404 Oct 24 13:26:25.765276 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 99/193] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:25 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:25.781540 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-31bd34ec-5eab-4c9c-9e91-794bc5a786b6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:25.781540 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-31bd34ec-5eab-4c9c-9e91-794bc5a786b6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:25.794982 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31bd34ec-5eab-4c9c-9e91-794bc5a786b6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:25.796616 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31bd34ec-5eab-4c9c-9e91-794bc5a786b6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:25.799459 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31bd34ec-5eab-4c9c-9e91-794bc5a786b6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:25.800442 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31bd34ec-5eab-4c9c-9e91-794bc5a786b6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:25.801934 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31bd34ec-5eab-4c9c-9e91-794bc5a786b6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:25.804911 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31bd34ec-5eab-4c9c-9e91-794bc5a786b6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:26.021455 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1dac6232-b73b-4aa1-a31d-9577d4089934 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:26.032145 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-1dac6232-b73b-4aa1-a31d-9577d4089934 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.959168 Oct 24 13:26:26.032984 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 95/194] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:25 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:26.091353 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-31bd34ec-5eab-4c9c-9e91-794bc5a786b6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:26.100373 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-31bd34ec-5eab-4c9c-9e91-794bc5a786b6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.333697 Oct 24 13:26:26.101911 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 100/195] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:25 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:26.333962 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0466aed5-e48d-405b-b105-545b67a0cccd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:26.334574 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0466aed5-e48d-405b-b105-545b67a0cccd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:26.341157 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0466aed5-e48d-405b-b105-545b67a0cccd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:26.341672 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0466aed5-e48d-405b-b105-545b67a0cccd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:26.342101 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0466aed5-e48d-405b-b105-545b67a0cccd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:26.342774 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0466aed5-e48d-405b-b105-545b67a0cccd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:26.343330 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0466aed5-e48d-405b-b105-545b67a0cccd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:26.343734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0466aed5-e48d-405b-b105-545b67a0cccd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:26.534715 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0466aed5-e48d-405b-b105-545b67a0cccd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:26.544373 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0466aed5-e48d-405b-b105-545b67a0cccd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.214417 Oct 24 13:26:26.551787 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 96/196] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:26 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:26.790337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-fb536d1b-fe98-4ebd-8fd0-76681c4ef089 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:26.790968 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-fb536d1b-fe98-4ebd-8fd0-76681c4ef089 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:26.797445 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fb536d1b-fe98-4ebd-8fd0-76681c4ef089 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:26.798079 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fb536d1b-fe98-4ebd-8fd0-76681c4ef089 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:26.798505 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fb536d1b-fe98-4ebd-8fd0-76681c4ef089 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:26.799177 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fb536d1b-fe98-4ebd-8fd0-76681c4ef089 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:26.799618 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fb536d1b-fe98-4ebd-8fd0-76681c4ef089 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:26.800214 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fb536d1b-fe98-4ebd-8fd0-76681c4ef089 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:26.938615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fb536d1b-fe98-4ebd-8fd0-76681c4ef089 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:26.947232 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fb536d1b-fe98-4ebd-8fd0-76681c4ef089 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:26.948690 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fb536d1b-fe98-4ebd-8fd0-76681c4ef089 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:26.949788 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-fb536d1b-fe98-4ebd-8fd0-76681c4ef089 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.164483 Oct 24 13:26:26.950354 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 101/197] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:26 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:27.055902 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6264a4b5-3440-44d5-b4c7-08ea05738b4f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:27.056548 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-6264a4b5-3440-44d5-b4c7-08ea05738b4f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:27.062510 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6264a4b5-3440-44d5-b4c7-08ea05738b4f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:27.063020 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6264a4b5-3440-44d5-b4c7-08ea05738b4f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:27.063442 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6264a4b5-3440-44d5-b4c7-08ea05738b4f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:27.064115 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6264a4b5-3440-44d5-b4c7-08ea05738b4f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:27.064614 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6264a4b5-3440-44d5-b4c7-08ea05738b4f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:27.065033 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6264a4b5-3440-44d5-b4c7-08ea05738b4f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:27.129085 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-19c89ac8-92ff-4085-9068-e2e8b9e17595 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:27.130462 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-19c89ac8-92ff-4085-9068-e2e8b9e17595 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:27.137374 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-19c89ac8-92ff-4085-9068-e2e8b9e17595 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:27.141940 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-19c89ac8-92ff-4085-9068-e2e8b9e17595 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:27.141940 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-19c89ac8-92ff-4085-9068-e2e8b9e17595 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:27.141940 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-19c89ac8-92ff-4085-9068-e2e8b9e17595 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:27.141940 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-19c89ac8-92ff-4085-9068-e2e8b9e17595 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:27.142273 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-19c89ac8-92ff-4085-9068-e2e8b9e17595 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:27.207681 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-6264a4b5-3440-44d5-b4c7-08ea05738b4f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:27.216369 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6264a4b5-3440-44d5-b4c7-08ea05738b4f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.164444 Oct 24 13:26:27.228842 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 97/198] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:27 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:27.315885 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-19c89ac8-92ff-4085-9068-e2e8b9e17595 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:27.325433 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-19c89ac8-92ff-4085-9068-e2e8b9e17595 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.200533 Oct 24 13:26:27.327164 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 102/199] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:27 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:27.571712 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1cb84707-9617-4a6c-a032-edaf621222b0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:27.572773 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-1cb84707-9617-4a6c-a032-edaf621222b0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:27.578428 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-67571058-5537-4950-bd33-0b10627ef2cf req-36bf6e72-e5a9-49b4-9cf0-4e7a21a1092c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b2c12f-1e60-4000-ac5c-d7a5864939a1", "name": "network-vif-plugged", "status": "completed", "tag": "cf65c088-1188-479e-a207-5b5919c77b82"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:26:27.604578 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1cb84707-9617-4a6c-a032-edaf621222b0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:27.605847 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1cb84707-9617-4a6c-a032-edaf621222b0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:27.606989 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1cb84707-9617-4a6c-a032-edaf621222b0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:27.608702 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1cb84707-9617-4a6c-a032-edaf621222b0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:27.610533 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1cb84707-9617-4a6c-a032-edaf621222b0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:27.612194 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1cb84707-9617-4a6c-a032-edaf621222b0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:27.614997 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-67571058-5537-4950-bd33-0b10627ef2cf req-36bf6e72-e5a9-49b4-9cf0-4e7a21a1092c service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:27.614997 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-67571058-5537-4950-bd33-0b10627ef2cf req-36bf6e72-e5a9-49b4-9cf0-4e7a21a1092c service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:27.614997 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-67571058-5537-4950-bd33-0b10627ef2cf req-36bf6e72-e5a9-49b4-9cf0-4e7a21a1092c service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:27.637921 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-67571058-5537-4950-bd33-0b10627ef2cf req-36bf6e72-e5a9-49b4-9cf0-4e7a21a1092c service nova] Creating event network-vif-plugged:cf65c088-1188-479e-a207-5b5919c77b82 for instance 48b2c12f-1e60-4000-ac5c-d7a5864939a1 on hv-cinder-86249 Oct 24 13:26:27.643390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-67571058-5537-4950-bd33-0b10627ef2cf req-36bf6e72-e5a9-49b4-9cf0-4e7a21a1092c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133585 Oct 24 13:26:27.644764 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 98/200] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:26:27.794179 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1cb84707-9617-4a6c-a032-edaf621222b0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:27.802017 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1cb84707-9617-4a6c-a032-edaf621222b0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.236507 Oct 24 13:26:27.802589 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 103/201] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:27 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:27.975571 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-cba8a21c-8186-4dbd-8620-ddb985094ab7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:27.976907 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-cba8a21c-8186-4dbd-8620-ddb985094ab7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:27.982946 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cba8a21c-8186-4dbd-8620-ddb985094ab7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:27.983418 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cba8a21c-8186-4dbd-8620-ddb985094ab7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:27.983846 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cba8a21c-8186-4dbd-8620-ddb985094ab7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:27.984545 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cba8a21c-8186-4dbd-8620-ddb985094ab7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:27.984993 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cba8a21c-8186-4dbd-8620-ddb985094ab7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:27.985409 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cba8a21c-8186-4dbd-8620-ddb985094ab7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:28.127042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-cba8a21c-8186-4dbd-8620-ddb985094ab7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:28.135434 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-cba8a21c-8186-4dbd-8620-ddb985094ab7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:28.136929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-cba8a21c-8186-4dbd-8620-ddb985094ab7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:28.138022 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-cba8a21c-8186-4dbd-8620-ddb985094ab7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.166750 Oct 24 13:26:28.138562 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 99/202] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:27 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:28.240822 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-16ce939d-dbd6-43f3-afa4-a14e2597329f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:28.241806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-16ce939d-dbd6-43f3-afa4-a14e2597329f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:28.247631 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-16ce939d-dbd6-43f3-afa4-a14e2597329f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:28.248112 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-16ce939d-dbd6-43f3-afa4-a14e2597329f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:28.248574 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-16ce939d-dbd6-43f3-afa4-a14e2597329f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:28.249268 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-16ce939d-dbd6-43f3-afa4-a14e2597329f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:28.249727 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-16ce939d-dbd6-43f3-afa4-a14e2597329f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:28.250130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-16ce939d-dbd6-43f3-afa4-a14e2597329f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:28.348428 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-d882c541-0cce-4cad-8705-b4345cdd1cdf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:28.349036 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-d882c541-0cce-4cad-8705-b4345cdd1cdf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:28.355382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d882c541-0cce-4cad-8705-b4345cdd1cdf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:28.355866 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d882c541-0cce-4cad-8705-b4345cdd1cdf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:28.356306 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d882c541-0cce-4cad-8705-b4345cdd1cdf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:28.357353 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d882c541-0cce-4cad-8705-b4345cdd1cdf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:28.357955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d882c541-0cce-4cad-8705-b4345cdd1cdf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:28.358534 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d882c541-0cce-4cad-8705-b4345cdd1cdf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:28.398976 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-16ce939d-dbd6-43f3-afa4-a14e2597329f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:28.433242 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-16ce939d-dbd6-43f3-afa4-a14e2597329f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.196085 Oct 24 13:26:28.434369 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 104/203] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:28 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:28.826213 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5429d674-d0cd-4416-99bf-0c6eb89ee13c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:28.826813 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5429d674-d0cd-4416-99bf-0c6eb89ee13c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:28.833209 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5429d674-d0cd-4416-99bf-0c6eb89ee13c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:28.833685 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5429d674-d0cd-4416-99bf-0c6eb89ee13c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:28.834334 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5429d674-d0cd-4416-99bf-0c6eb89ee13c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:28.835409 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5429d674-d0cd-4416-99bf-0c6eb89ee13c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:28.836033 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5429d674-d0cd-4416-99bf-0c6eb89ee13c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:28.836482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5429d674-d0cd-4416-99bf-0c6eb89ee13c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:28.912261 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-d882c541-0cce-4cad-8705-b4345cdd1cdf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:28.922604 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-d882c541-0cce-4cad-8705-b4345cdd1cdf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.577875 Oct 24 13:26:28.928450 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 100/204] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:28 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:28.977298 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5429d674-d0cd-4416-99bf-0c6eb89ee13c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:28.986481 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5429d674-d0cd-4416-99bf-0c6eb89ee13c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.163939 Oct 24 13:26:28.987476 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 105/205] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:28 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:29.164446 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-359d904f-fff3-4524-826a-4f081e1eff8d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:29.165148 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-359d904f-fff3-4524-826a-4f081e1eff8d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:29.173725 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-359d904f-fff3-4524-826a-4f081e1eff8d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:29.174201 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-359d904f-fff3-4524-826a-4f081e1eff8d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:29.174624 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-359d904f-fff3-4524-826a-4f081e1eff8d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:29.177440 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-359d904f-fff3-4524-826a-4f081e1eff8d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:29.177440 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-359d904f-fff3-4524-826a-4f081e1eff8d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:29.177440 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-359d904f-fff3-4524-826a-4f081e1eff8d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:29.484535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-08f90a59-69d1-474b-aeee-9ceca0f85c54 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:29.486964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-08f90a59-69d1-474b-aeee-9ceca0f85c54 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:29.510452 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-08f90a59-69d1-474b-aeee-9ceca0f85c54 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:29.510954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-08f90a59-69d1-474b-aeee-9ceca0f85c54 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:29.511391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-08f90a59-69d1-474b-aeee-9ceca0f85c54 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:29.512117 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-08f90a59-69d1-474b-aeee-9ceca0f85c54 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:29.512593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-08f90a59-69d1-474b-aeee-9ceca0f85c54 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:29.513012 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-08f90a59-69d1-474b-aeee-9ceca0f85c54 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:29.887504 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-359d904f-fff3-4524-826a-4f081e1eff8d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:29.923105 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-359d904f-fff3-4524-826a-4f081e1eff8d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:29.928574 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-359d904f-fff3-4524-826a-4f081e1eff8d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:29.938745 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-359d904f-fff3-4524-826a-4f081e1eff8d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.772398 Oct 24 13:26:29.938745 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 101/206] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:29 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:29.961495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9b59a102-2584-474b-8fe5-63f56c6936d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:29.962614 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9b59a102-2584-474b-8fe5-63f56c6936d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:29.971195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9b59a102-2584-474b-8fe5-63f56c6936d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:29.972112 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9b59a102-2584-474b-8fe5-63f56c6936d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:29.972726 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9b59a102-2584-474b-8fe5-63f56c6936d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:29.973655 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9b59a102-2584-474b-8fe5-63f56c6936d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:29.974247 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9b59a102-2584-474b-8fe5-63f56c6936d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:29.974810 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9b59a102-2584-474b-8fe5-63f56c6936d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:30.247659 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-08f90a59-69d1-474b-aeee-9ceca0f85c54 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:30.265130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-08f90a59-69d1-474b-aeee-9ceca0f85c54 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.810136 Oct 24 13:26:30.265946 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 106/207] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:29 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:30.286869 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e49b025e-fb44-4d25-991a-85d0decc01cf tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:30.287611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e49b025e-fb44-4d25-991a-85d0decc01cf tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:30.300086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e49b025e-fb44-4d25-991a-85d0decc01cf tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:30.301133 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e49b025e-fb44-4d25-991a-85d0decc01cf tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:30.302374 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e49b025e-fb44-4d25-991a-85d0decc01cf tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:30.303350 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e49b025e-fb44-4d25-991a-85d0decc01cf tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:30.303821 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e49b025e-fb44-4d25-991a-85d0decc01cf tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:30.307254 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e49b025e-fb44-4d25-991a-85d0decc01cf tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:30.568143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9b59a102-2584-474b-8fe5-63f56c6936d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:30.603468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9b59a102-2584-474b-8fe5-63f56c6936d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.650344 Oct 24 13:26:30.604800 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 102/208] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:29 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:30.673446 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e49b025e-fb44-4d25-991a-85d0decc01cf tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:30.681900 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e49b025e-fb44-4d25-991a-85d0decc01cf tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.414590 Oct 24 13:26:30.682571 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 107/209] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:30 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:30.967493 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e3564873-0b55-492c-9433-c335332b5ca8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:30.968364 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e3564873-0b55-492c-9433-c335332b5ca8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:30.974279 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e3564873-0b55-492c-9433-c335332b5ca8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:30.974750 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e3564873-0b55-492c-9433-c335332b5ca8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:30.975341 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e3564873-0b55-492c-9433-c335332b5ca8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:30.976599 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e3564873-0b55-492c-9433-c335332b5ca8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:30.977144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e3564873-0b55-492c-9433-c335332b5ca8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:30.977558 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e3564873-0b55-492c-9433-c335332b5ca8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:31.132452 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e3564873-0b55-492c-9433-c335332b5ca8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:31.141473 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e3564873-0b55-492c-9433-c335332b5ca8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:31.143302 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e3564873-0b55-492c-9433-c335332b5ca8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:31.149394 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e3564873-0b55-492c-9433-c335332b5ca8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.181159 Oct 24 13:26:31.149394 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 103/210] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:30 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:26:31.294793 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c7a8c993-277d-42d5-970a-2591e75e382f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:31.295567 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c7a8c993-277d-42d5-970a-2591e75e382f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:31.295856 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-a23302f7-1884-4341-aade-8c652be64259 req-3e306366-ef08-4def-a5b7-bcf0e55fc600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a9564e-c320-4bad-bcfc-8332aec8c690", "name": "network-vif-plugged", "status": "completed", "tag": "88cc8087-11c0-4a7a-b07d-0fa49eefb5f0"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:26:31.304399 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c7a8c993-277d-42d5-970a-2591e75e382f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:31.306007 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c7a8c993-277d-42d5-970a-2591e75e382f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:31.307032 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c7a8c993-277d-42d5-970a-2591e75e382f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:31.310812 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-a23302f7-1884-4341-aade-8c652be64259 req-3e306366-ef08-4def-a5b7-bcf0e55fc600 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:31.310966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c7a8c993-277d-42d5-970a-2591e75e382f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:31.311430 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c7a8c993-277d-42d5-970a-2591e75e382f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:31.311599 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-a23302f7-1884-4341-aade-8c652be64259 req-3e306366-ef08-4def-a5b7-bcf0e55fc600 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:31.312138 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-a23302f7-1884-4341-aade-8c652be64259 req-3e306366-ef08-4def-a5b7-bcf0e55fc600 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:31.312570 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c7a8c993-277d-42d5-970a-2591e75e382f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:31.328479 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-a23302f7-1884-4341-aade-8c652be64259 req-3e306366-ef08-4def-a5b7-bcf0e55fc600 service nova] Creating event network-vif-plugged:88cc8087-11c0-4a7a-b07d-0fa49eefb5f0 for instance 13a9564e-c320-4bad-bcfc-8332aec8c690 on hv-cinder-86249 Oct 24 13:26:31.334827 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-a23302f7-1884-4341-aade-8c652be64259 req-3e306366-ef08-4def-a5b7-bcf0e55fc600 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048890 Oct 24 13:26:31.342886 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 104/211] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:26:31.345659 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=100 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:31.471981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c7a8c993-277d-42d5-970a-2591e75e382f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:31.480177 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c7a8c993-277d-42d5-970a-2591e75e382f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.195317 Oct 24 13:26:31.480890 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 108/212] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:31 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:31.634665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b148ace9-475b-4ab9-8d84-363090c8b1ab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:31.635869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b148ace9-475b-4ab9-8d84-363090c8b1ab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:31.644772 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b148ace9-475b-4ab9-8d84-363090c8b1ab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:31.645435 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b148ace9-475b-4ab9-8d84-363090c8b1ab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:31.646211 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b148ace9-475b-4ab9-8d84-363090c8b1ab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:31.647235 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b148ace9-475b-4ab9-8d84-363090c8b1ab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:31.648493 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b148ace9-475b-4ab9-8d84-363090c8b1ab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:31.649119 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b148ace9-475b-4ab9-8d84-363090c8b1ab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:31.708167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-feec13c8-47b6-4d2b-b8c0-c4c1f18284a9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:31.708999 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-feec13c8-47b6-4d2b-b8c0-c4c1f18284a9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:31.720455 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-feec13c8-47b6-4d2b-b8c0-c4c1f18284a9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:31.721137 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-feec13c8-47b6-4d2b-b8c0-c4c1f18284a9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:31.725319 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-feec13c8-47b6-4d2b-b8c0-c4c1f18284a9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:31.725319 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-feec13c8-47b6-4d2b-b8c0-c4c1f18284a9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:31.725319 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-feec13c8-47b6-4d2b-b8c0-c4c1f18284a9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:31.725319 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-feec13c8-47b6-4d2b-b8c0-c4c1f18284a9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:31.825146 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b148ace9-475b-4ab9-8d84-363090c8b1ab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:31.833992 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b148ace9-475b-4ab9-8d84-363090c8b1ab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.206906 Oct 24 13:26:31.834569 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 105/213] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:31 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:31.900380 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-feec13c8-47b6-4d2b-b8c0-c4c1f18284a9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:31.908667 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-feec13c8-47b6-4d2b-b8c0-c4c1f18284a9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.206944 Oct 24 13:26:31.909243 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 109/214] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:31 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:32.172239 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-74302d95-7d10-494d-b338-71753bb7eaf6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:32.173180 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-74302d95-7d10-494d-b338-71753bb7eaf6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:32.180440 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-74302d95-7d10-494d-b338-71753bb7eaf6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:32.181112 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-74302d95-7d10-494d-b338-71753bb7eaf6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:32.181737 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-74302d95-7d10-494d-b338-71753bb7eaf6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:32.182749 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-74302d95-7d10-494d-b338-71753bb7eaf6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:32.183532 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-74302d95-7d10-494d-b338-71753bb7eaf6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:32.184093 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-74302d95-7d10-494d-b338-71753bb7eaf6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:32.217729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=100 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:32.358954 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-74302d95-7d10-494d-b338-71753bb7eaf6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:32.368073 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-74302d95-7d10-494d-b338-71753bb7eaf6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:32.369698 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-74302d95-7d10-494d-b338-71753bb7eaf6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:32.369698 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-74302d95-7d10-494d-b338-71753bb7eaf6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.202511 Oct 24 13:26:32.369698 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 106/215] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:32 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:32.503520 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5dc856be-2cdf-4d7e-89cc-be4501585318 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:32.504412 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5dc856be-2cdf-4d7e-89cc-be4501585318 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:32.510888 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5dc856be-2cdf-4d7e-89cc-be4501585318 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:32.511367 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5dc856be-2cdf-4d7e-89cc-be4501585318 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:32.511788 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5dc856be-2cdf-4d7e-89cc-be4501585318 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:32.512501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5dc856be-2cdf-4d7e-89cc-be4501585318 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:32.512941 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5dc856be-2cdf-4d7e-89cc-be4501585318 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:32.513348 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5dc856be-2cdf-4d7e-89cc-be4501585318 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:32.655333 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5dc856be-2cdf-4d7e-89cc-be4501585318 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:32.664468 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5dc856be-2cdf-4d7e-89cc-be4501585318 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.164840 Oct 24 13:26:32.665033 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 110/216] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:32 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:32.857430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e026a25b-8fb3-4e5b-ad51-ffe81ecd53ed tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:32.858027 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e026a25b-8fb3-4e5b-ad51-ffe81ecd53ed tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:32.864290 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e026a25b-8fb3-4e5b-ad51-ffe81ecd53ed tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:32.864808 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e026a25b-8fb3-4e5b-ad51-ffe81ecd53ed tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:32.865181 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e026a25b-8fb3-4e5b-ad51-ffe81ecd53ed tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:32.865847 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e026a25b-8fb3-4e5b-ad51-ffe81ecd53ed tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:32.866291 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e026a25b-8fb3-4e5b-ad51-ffe81ecd53ed tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:32.866759 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e026a25b-8fb3-4e5b-ad51-ffe81ecd53ed tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:32.946138 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-575fd8e2-b0c2-4bee-9408-8c0a5b9b1c44 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:32.948715 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-575fd8e2-b0c2-4bee-9408-8c0a5b9b1c44 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:32.959085 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-575fd8e2-b0c2-4bee-9408-8c0a5b9b1c44 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:32.959856 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-575fd8e2-b0c2-4bee-9408-8c0a5b9b1c44 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:32.961158 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-575fd8e2-b0c2-4bee-9408-8c0a5b9b1c44 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:32.962158 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-575fd8e2-b0c2-4bee-9408-8c0a5b9b1c44 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:32.962758 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-575fd8e2-b0c2-4bee-9408-8c0a5b9b1c44 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:32.963177 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-575fd8e2-b0c2-4bee-9408-8c0a5b9b1c44 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:33.058666 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e026a25b-8fb3-4e5b-ad51-ffe81ecd53ed tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:33.066815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e026a25b-8fb3-4e5b-ad51-ffe81ecd53ed tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.213627 Oct 24 13:26:33.068015 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 107/217] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:32 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:33.123385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-575fd8e2-b0c2-4bee-9408-8c0a5b9b1c44 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:33.131461 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-575fd8e2-b0c2-4bee-9408-8c0a5b9b1c44 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.195867 Oct 24 13:26:33.132611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 111/218] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:32 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:33.398751 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9ab97368-1431-4d95-a098-24896e53d60f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:33.399376 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9ab97368-1431-4d95-a098-24896e53d60f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:33.405718 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ab97368-1431-4d95-a098-24896e53d60f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:33.406236 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ab97368-1431-4d95-a098-24896e53d60f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:33.406590 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ab97368-1431-4d95-a098-24896e53d60f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:33.407261 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ab97368-1431-4d95-a098-24896e53d60f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:33.407704 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ab97368-1431-4d95-a098-24896e53d60f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:33.408105 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ab97368-1431-4d95-a098-24896e53d60f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:33.559304 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9ab97368-1431-4d95-a098-24896e53d60f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:33.569165 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9ab97368-1431-4d95-a098-24896e53d60f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:33.570762 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9ab97368-1431-4d95-a098-24896e53d60f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:33.571985 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9ab97368-1431-4d95-a098-24896e53d60f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.179936 Oct 24 13:26:33.572652 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 108/219] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:33 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:33.688990 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-838f4cf2-2759-4038-a118-cf298c5a09ab tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:33.689948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-838f4cf2-2759-4038-a118-cf298c5a09ab tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:33.696971 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-838f4cf2-2759-4038-a118-cf298c5a09ab tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:33.697686 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-838f4cf2-2759-4038-a118-cf298c5a09ab tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:33.698524 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-838f4cf2-2759-4038-a118-cf298c5a09ab tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:33.699339 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-838f4cf2-2759-4038-a118-cf298c5a09ab tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:33.699900 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-838f4cf2-2759-4038-a118-cf298c5a09ab tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:33.700463 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-838f4cf2-2759-4038-a118-cf298c5a09ab tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:33.853018 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-838f4cf2-2759-4038-a118-cf298c5a09ab tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:33.860630 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-838f4cf2-2759-4038-a118-cf298c5a09ab tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.176935 Oct 24 13:26:33.863111 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 112/220] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:33 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:34.091826 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6726fb9b-828b-45da-ac62-27492106c24b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:34.092963 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-6726fb9b-828b-45da-ac62-27492106c24b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:34.099043 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6726fb9b-828b-45da-ac62-27492106c24b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:34.099599 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6726fb9b-828b-45da-ac62-27492106c24b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:34.100309 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6726fb9b-828b-45da-ac62-27492106c24b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:34.101469 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6726fb9b-828b-45da-ac62-27492106c24b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:34.101920 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6726fb9b-828b-45da-ac62-27492106c24b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:34.102340 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6726fb9b-828b-45da-ac62-27492106c24b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:34.155159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f9b141e2-6996-4080-8472-5fe6090acddd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:34.155763 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f9b141e2-6996-4080-8472-5fe6090acddd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:34.161988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f9b141e2-6996-4080-8472-5fe6090acddd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:34.162507 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f9b141e2-6996-4080-8472-5fe6090acddd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:34.165284 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f9b141e2-6996-4080-8472-5fe6090acddd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:34.165284 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f9b141e2-6996-4080-8472-5fe6090acddd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:34.165284 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f9b141e2-6996-4080-8472-5fe6090acddd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:34.165284 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f9b141e2-6996-4080-8472-5fe6090acddd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:34.246544 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-6726fb9b-828b-45da-ac62-27492106c24b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:34.262818 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6726fb9b-828b-45da-ac62-27492106c24b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.174688 Oct 24 13:26:34.263434 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 109/221] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:34 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:34.304930 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f9b141e2-6996-4080-8472-5fe6090acddd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:34.315114 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f9b141e2-6996-4080-8472-5fe6090acddd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.163732 Oct 24 13:26:34.322848 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 113/222] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:34 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:34.597395 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-57efaf72-d026-41f8-aac8-9c83c84cc6bf tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:34.597999 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-57efaf72-d026-41f8-aac8-9c83c84cc6bf tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:34.603983 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-57efaf72-d026-41f8-aac8-9c83c84cc6bf tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:34.604486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-57efaf72-d026-41f8-aac8-9c83c84cc6bf tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:34.604913 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-57efaf72-d026-41f8-aac8-9c83c84cc6bf tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:34.605585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-57efaf72-d026-41f8-aac8-9c83c84cc6bf tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:34.606031 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-57efaf72-d026-41f8-aac8-9c83c84cc6bf tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:34.606444 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-57efaf72-d026-41f8-aac8-9c83c84cc6bf tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:34.756110 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-57efaf72-d026-41f8-aac8-9c83c84cc6bf tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:34.764981 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-57efaf72-d026-41f8-aac8-9c83c84cc6bf tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:34.766478 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-57efaf72-d026-41f8-aac8-9c83c84cc6bf tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:34.767558 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-57efaf72-d026-41f8-aac8-9c83c84cc6bf tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.174114 Oct 24 13:26:34.768108 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 110/223] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:34 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:34.884520 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-020a7a9d-bbb5-44c6-bb21-13a82fde13fe tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:34.885134 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-020a7a9d-bbb5-44c6-bb21-13a82fde13fe tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:34.891732 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-020a7a9d-bbb5-44c6-bb21-13a82fde13fe tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:34.891732 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-020a7a9d-bbb5-44c6-bb21-13a82fde13fe tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:34.891992 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-020a7a9d-bbb5-44c6-bb21-13a82fde13fe tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:34.892711 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-020a7a9d-bbb5-44c6-bb21-13a82fde13fe tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:34.893163 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-020a7a9d-bbb5-44c6-bb21-13a82fde13fe tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:34.893581 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-020a7a9d-bbb5-44c6-bb21-13a82fde13fe tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:35.022119 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-020a7a9d-bbb5-44c6-bb21-13a82fde13fe tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:35.030053 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-020a7a9d-bbb5-44c6-bb21-13a82fde13fe tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.149846 Oct 24 13:26:35.030749 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 114/224] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:34 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:35.286178 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-925d5cc5-18c7-4a17-9b39-c84e4154ac26 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:35.286783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-925d5cc5-18c7-4a17-9b39-c84e4154ac26 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:35.293146 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-925d5cc5-18c7-4a17-9b39-c84e4154ac26 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:35.293616 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-925d5cc5-18c7-4a17-9b39-c84e4154ac26 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:35.294041 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-925d5cc5-18c7-4a17-9b39-c84e4154ac26 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:35.294718 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-925d5cc5-18c7-4a17-9b39-c84e4154ac26 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:35.295166 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-925d5cc5-18c7-4a17-9b39-c84e4154ac26 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:35.295582 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-925d5cc5-18c7-4a17-9b39-c84e4154ac26 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:35.340469 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e3aca4d7-4441-4ba2-85f1-53fe4d97320f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:35.342899 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e3aca4d7-4441-4ba2-85f1-53fe4d97320f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:35.349849 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e3aca4d7-4441-4ba2-85f1-53fe4d97320f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:35.350327 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e3aca4d7-4441-4ba2-85f1-53fe4d97320f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:35.351279 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e3aca4d7-4441-4ba2-85f1-53fe4d97320f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:35.351967 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e3aca4d7-4441-4ba2-85f1-53fe4d97320f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:35.352438 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e3aca4d7-4441-4ba2-85f1-53fe4d97320f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:35.353067 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e3aca4d7-4441-4ba2-85f1-53fe4d97320f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:35.461892 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-925d5cc5-18c7-4a17-9b39-c84e4154ac26 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:35.469750 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-925d5cc5-18c7-4a17-9b39-c84e4154ac26 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.187337 Oct 24 13:26:35.470330 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 111/225] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:35 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:35.498212 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e3aca4d7-4441-4ba2-85f1-53fe4d97320f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:35.506880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e3aca4d7-4441-4ba2-85f1-53fe4d97320f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.171560 Oct 24 13:26:35.507721 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 115/226] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:35 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:35.794132 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-1100dc47-17b0-485a-b638-41c1c7ede55f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:35.795387 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-1100dc47-17b0-485a-b638-41c1c7ede55f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:35.803044 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1100dc47-17b0-485a-b638-41c1c7ede55f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:35.803200 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1100dc47-17b0-485a-b638-41c1c7ede55f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:35.803930 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1100dc47-17b0-485a-b638-41c1c7ede55f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:35.804914 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1100dc47-17b0-485a-b638-41c1c7ede55f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:35.805362 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1100dc47-17b0-485a-b638-41c1c7ede55f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:35.805821 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1100dc47-17b0-485a-b638-41c1c7ede55f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:35.957862 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1100dc47-17b0-485a-b638-41c1c7ede55f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:35.966554 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1100dc47-17b0-485a-b638-41c1c7ede55f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:35.967995 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1100dc47-17b0-485a-b638-41c1c7ede55f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:35.969117 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-1100dc47-17b0-485a-b638-41c1c7ede55f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.179813 Oct 24 13:26:35.969658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 112/227] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:35 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:36.056597 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5a62987f-a192-4ef0-841d-6784a71af4b2 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:36.057821 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5a62987f-a192-4ef0-841d-6784a71af4b2 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:36.066797 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5a62987f-a192-4ef0-841d-6784a71af4b2 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:36.067393 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5a62987f-a192-4ef0-841d-6784a71af4b2 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:36.079526 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5a62987f-a192-4ef0-841d-6784a71af4b2 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:36.079526 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5a62987f-a192-4ef0-841d-6784a71af4b2 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:36.079526 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5a62987f-a192-4ef0-841d-6784a71af4b2 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:36.079526 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5a62987f-a192-4ef0-841d-6784a71af4b2 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:36.247692 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5a62987f-a192-4ef0-841d-6784a71af4b2 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:36.255544 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5a62987f-a192-4ef0-841d-6784a71af4b2 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.204177 Oct 24 13:26:36.256114 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 116/228] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:36 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:36.495258 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-4dea6a88-3cbb-462f-9cd8-d1a16e795ead tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:36.495987 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-4dea6a88-3cbb-462f-9cd8-d1a16e795ead tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:36.501932 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4dea6a88-3cbb-462f-9cd8-d1a16e795ead tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:36.502464 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4dea6a88-3cbb-462f-9cd8-d1a16e795ead tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:36.502891 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4dea6a88-3cbb-462f-9cd8-d1a16e795ead tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:36.503611 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4dea6a88-3cbb-462f-9cd8-d1a16e795ead tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:36.504066 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4dea6a88-3cbb-462f-9cd8-d1a16e795ead tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:36.504506 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4dea6a88-3cbb-462f-9cd8-d1a16e795ead tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:36.539668 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-53f1656e-439a-40ec-be13-df98b4a3b124 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:36.540305 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-53f1656e-439a-40ec-be13-df98b4a3b124 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:36.547397 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53f1656e-439a-40ec-be13-df98b4a3b124 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:36.548073 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53f1656e-439a-40ec-be13-df98b4a3b124 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:36.548766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53f1656e-439a-40ec-be13-df98b4a3b124 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:36.549764 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53f1656e-439a-40ec-be13-df98b4a3b124 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:36.550434 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53f1656e-439a-40ec-be13-df98b4a3b124 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:36.550924 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53f1656e-439a-40ec-be13-df98b4a3b124 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:36.672249 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-4dea6a88-3cbb-462f-9cd8-d1a16e795ead tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:36.680784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-4dea6a88-3cbb-462f-9cd8-d1a16e795ead tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.189945 Oct 24 13:26:36.681655 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 113/229] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:36 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:36.698675 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-53f1656e-439a-40ec-be13-df98b4a3b124 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:36.706811 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-53f1656e-439a-40ec-be13-df98b4a3b124 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.176407 Oct 24 13:26:36.707376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 117/230] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:36 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:36.993056 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c146a8c2-af99-47e2-a25c-82d456b89651 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:36.993648 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-c146a8c2-af99-47e2-a25c-82d456b89651 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:36.999508 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c146a8c2-af99-47e2-a25c-82d456b89651 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:36.999969 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c146a8c2-af99-47e2-a25c-82d456b89651 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:37.000415 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c146a8c2-af99-47e2-a25c-82d456b89651 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:37.001088 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c146a8c2-af99-47e2-a25c-82d456b89651 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:37.001550 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c146a8c2-af99-47e2-a25c-82d456b89651 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:37.002144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c146a8c2-af99-47e2-a25c-82d456b89651 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:37.150955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c146a8c2-af99-47e2-a25c-82d456b89651 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:37.159079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c146a8c2-af99-47e2-a25c-82d456b89651 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:37.160562 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c146a8c2-af99-47e2-a25c-82d456b89651 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:37.161688 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-c146a8c2-af99-47e2-a25c-82d456b89651 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.172636 Oct 24 13:26:37.162252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 114/231] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:36 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:37.293588 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-30fc6ca3-8364-4071-ac46-669da77ebf28 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:37.294495 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-30fc6ca3-8364-4071-ac46-669da77ebf28 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:37.306652 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-30fc6ca3-8364-4071-ac46-669da77ebf28 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:37.307139 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-30fc6ca3-8364-4071-ac46-669da77ebf28 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:37.307570 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-30fc6ca3-8364-4071-ac46-669da77ebf28 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:37.308351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-30fc6ca3-8364-4071-ac46-669da77ebf28 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:37.308798 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-30fc6ca3-8364-4071-ac46-669da77ebf28 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:37.309233 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-30fc6ca3-8364-4071-ac46-669da77ebf28 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:37.450397 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-30fc6ca3-8364-4071-ac46-669da77ebf28 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:37.460941 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-30fc6ca3-8364-4071-ac46-669da77ebf28 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.177810 Oct 24 13:26:37.461520 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 118/232] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:37 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:37.579817 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-4ecfa58e-e61c-46cc-bcdc-10946791034e req-d35aa9f5-f83d-4d2c-a68e-778c17ea924b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d04bbb-034d-4cf1-a753-9c4cb48e92bd", "name": "network-vif-plugged", "status": "completed", "tag": "4dfc7079-30d9-488d-9dfc-1df75d250b32"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:26:37.589479 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-4ecfa58e-e61c-46cc-bcdc-10946791034e req-d35aa9f5-f83d-4d2c-a68e-778c17ea924b service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:37.589977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-4ecfa58e-e61c-46cc-bcdc-10946791034e req-d35aa9f5-f83d-4d2c-a68e-778c17ea924b service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:37.590394 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-4ecfa58e-e61c-46cc-bcdc-10946791034e req-d35aa9f5-f83d-4d2c-a68e-778c17ea924b service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:37.601740 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-4ecfa58e-e61c-46cc-bcdc-10946791034e req-d35aa9f5-f83d-4d2c-a68e-778c17ea924b service nova] Creating event network-vif-plugged:4dfc7079-30d9-488d-9dfc-1df75d250b32 for instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd on hv-cinder-86249 Oct 24 13:26:37.606932 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-4ecfa58e-e61c-46cc-bcdc-10946791034e req-d35aa9f5-f83d-4d2c-a68e-778c17ea924b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030621 Oct 24 13:26:37.607551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 115/233] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:26:37.704361 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-d6dd37c7-bf56-4e9b-a896-e773dc08e5e4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:37.704971 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-d6dd37c7-bf56-4e9b-a896-e773dc08e5e4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:37.712064 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d6dd37c7-bf56-4e9b-a896-e773dc08e5e4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:37.712659 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d6dd37c7-bf56-4e9b-a896-e773dc08e5e4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:37.713090 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d6dd37c7-bf56-4e9b-a896-e773dc08e5e4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:37.713804 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d6dd37c7-bf56-4e9b-a896-e773dc08e5e4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:37.714251 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d6dd37c7-bf56-4e9b-a896-e773dc08e5e4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:37.714702 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d6dd37c7-bf56-4e9b-a896-e773dc08e5e4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:37.741361 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-d07fbe67-4491-41e4-9a1e-35ebaed2db54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:37.742833 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-d07fbe67-4491-41e4-9a1e-35ebaed2db54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:37.754880 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d07fbe67-4491-41e4-9a1e-35ebaed2db54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:37.757794 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d07fbe67-4491-41e4-9a1e-35ebaed2db54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:37.758518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d07fbe67-4491-41e4-9a1e-35ebaed2db54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:37.760535 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d07fbe67-4491-41e4-9a1e-35ebaed2db54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:37.761076 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d07fbe67-4491-41e4-9a1e-35ebaed2db54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:37.762394 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d07fbe67-4491-41e4-9a1e-35ebaed2db54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:37.852540 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-d6dd37c7-bf56-4e9b-a896-e773dc08e5e4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:37.860520 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-d6dd37c7-bf56-4e9b-a896-e773dc08e5e4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.160104 Oct 24 13:26:37.861334 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 119/234] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:37 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:37.907088 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-d07fbe67-4491-41e4-9a1e-35ebaed2db54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:37.916630 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-d07fbe67-4491-41e4-9a1e-35ebaed2db54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.182291 Oct 24 13:26:37.917206 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 116/235] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:37 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:38.187121 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9ff99c0c-c67f-442b-a235-4b9d21077984 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:38.187724 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-9ff99c0c-c67f-442b-a235-4b9d21077984 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:38.193897 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9ff99c0c-c67f-442b-a235-4b9d21077984 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:38.194370 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9ff99c0c-c67f-442b-a235-4b9d21077984 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:38.194788 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9ff99c0c-c67f-442b-a235-4b9d21077984 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:38.195463 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9ff99c0c-c67f-442b-a235-4b9d21077984 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:38.195898 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9ff99c0c-c67f-442b-a235-4b9d21077984 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:38.196334 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9ff99c0c-c67f-442b-a235-4b9d21077984 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:38.329435 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-9ff99c0c-c67f-442b-a235-4b9d21077984 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:38.338295 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-9ff99c0c-c67f-442b-a235-4b9d21077984 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:38.339622 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-9ff99c0c-c67f-442b-a235-4b9d21077984 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:38.340739 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9ff99c0c-c67f-442b-a235-4b9d21077984 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.157634 Oct 24 13:26:38.341291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 120/236] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:38 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:38.485009 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a1ad9085-7999-481a-8504-b8b1aa3f1dd7 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:38.486237 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a1ad9085-7999-481a-8504-b8b1aa3f1dd7 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:38.493304 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1ad9085-7999-481a-8504-b8b1aa3f1dd7 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:38.498209 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1ad9085-7999-481a-8504-b8b1aa3f1dd7 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:38.498209 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1ad9085-7999-481a-8504-b8b1aa3f1dd7 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:38.498209 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1ad9085-7999-481a-8504-b8b1aa3f1dd7 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:38.498209 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1ad9085-7999-481a-8504-b8b1aa3f1dd7 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:38.498949 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1ad9085-7999-481a-8504-b8b1aa3f1dd7 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:38.664540 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a1ad9085-7999-481a-8504-b8b1aa3f1dd7 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:38.675105 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a1ad9085-7999-481a-8504-b8b1aa3f1dd7 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.193447 Oct 24 13:26:38.676313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 117/237] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:38 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:38.884618 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a58b114a-ef41-4eb0-a64d-01afd66d4294 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:38.885223 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a58b114a-ef41-4eb0-a64d-01afd66d4294 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:38.891608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a58b114a-ef41-4eb0-a64d-01afd66d4294 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:38.892374 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a58b114a-ef41-4eb0-a64d-01afd66d4294 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:38.892963 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a58b114a-ef41-4eb0-a64d-01afd66d4294 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:38.893647 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a58b114a-ef41-4eb0-a64d-01afd66d4294 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:38.894261 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a58b114a-ef41-4eb0-a64d-01afd66d4294 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:38.894670 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a58b114a-ef41-4eb0-a64d-01afd66d4294 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:38.942574 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0c4b8161-1a0f-459f-8a1c-66b57c6bd2df tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:38.943527 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0c4b8161-1a0f-459f-8a1c-66b57c6bd2df tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:38.958560 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0c4b8161-1a0f-459f-8a1c-66b57c6bd2df tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:38.959344 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0c4b8161-1a0f-459f-8a1c-66b57c6bd2df tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:38.960017 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0c4b8161-1a0f-459f-8a1c-66b57c6bd2df tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:38.961579 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0c4b8161-1a0f-459f-8a1c-66b57c6bd2df tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:38.965966 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0c4b8161-1a0f-459f-8a1c-66b57c6bd2df tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:38.965966 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0c4b8161-1a0f-459f-8a1c-66b57c6bd2df tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:39.045318 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a58b114a-ef41-4eb0-a64d-01afd66d4294 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:39.054886 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a58b114a-ef41-4eb0-a64d-01afd66d4294 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.174666 Oct 24 13:26:39.055463 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 121/238] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:38 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:39.310162 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0c4b8161-1a0f-459f-8a1c-66b57c6bd2df tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:39.317798 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0c4b8161-1a0f-459f-8a1c-66b57c6bd2df tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.379091 Oct 24 13:26:39.332512 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 118/239] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:38 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:39.367822 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-61b03443-96da-4a3f-a667-004bb08a13df tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:39.368541 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-61b03443-96da-4a3f-a667-004bb08a13df tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:39.374551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-61b03443-96da-4a3f-a667-004bb08a13df tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:39.376124 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-61b03443-96da-4a3f-a667-004bb08a13df tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:39.376124 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-61b03443-96da-4a3f-a667-004bb08a13df tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:39.376331 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-61b03443-96da-4a3f-a667-004bb08a13df tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:39.376733 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-61b03443-96da-4a3f-a667-004bb08a13df tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:39.377185 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-61b03443-96da-4a3f-a667-004bb08a13df tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:39.520395 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-61b03443-96da-4a3f-a667-004bb08a13df tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:39.541893 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-61b03443-96da-4a3f-a667-004bb08a13df tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:39.541893 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-61b03443-96da-4a3f-a667-004bb08a13df tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:39.541893 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-61b03443-96da-4a3f-a667-004bb08a13df tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.171431 Oct 24 13:26:39.542224 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 122/240] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:39 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:39.636686 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-7ea7d742-3798-4bfc-9b0f-be0db235680b req-15ce8326-7d6f-4034-9277-a3d5f02b0601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de4c382-e12d-4068-96c2-58d44e5265db", "name": "network-vif-plugged", "status": "completed", "tag": "c7b02435-39c6-46a8-a356-81bef309201a"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:26:39.646854 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-7ea7d742-3798-4bfc-9b0f-be0db235680b req-15ce8326-7d6f-4034-9277-a3d5f02b0601 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:39.656667 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-7ea7d742-3798-4bfc-9b0f-be0db235680b req-15ce8326-7d6f-4034-9277-a3d5f02b0601 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:39.657255 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-7ea7d742-3798-4bfc-9b0f-be0db235680b req-15ce8326-7d6f-4034-9277-a3d5f02b0601 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:39.671775 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-7ea7d742-3798-4bfc-9b0f-be0db235680b req-15ce8326-7d6f-4034-9277-a3d5f02b0601 service nova] Creating event network-vif-plugged:c7b02435-39c6-46a8-a356-81bef309201a for instance 8de4c382-e12d-4068-96c2-58d44e5265db on hv-cinder-86249 Oct 24 13:26:39.677283 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-7ea7d742-3798-4bfc-9b0f-be0db235680b req-15ce8326-7d6f-4034-9277-a3d5f02b0601 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045624 Oct 24 13:26:39.678134 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 119/241] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:26:39.709980 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-0362cf43-b73d-47ef-bb79-652235fdf2c5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:39.711076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-0362cf43-b73d-47ef-bb79-652235fdf2c5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:39.718379 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0362cf43-b73d-47ef-bb79-652235fdf2c5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:39.719073 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0362cf43-b73d-47ef-bb79-652235fdf2c5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:39.719772 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0362cf43-b73d-47ef-bb79-652235fdf2c5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:39.720695 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0362cf43-b73d-47ef-bb79-652235fdf2c5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:39.721454 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0362cf43-b73d-47ef-bb79-652235fdf2c5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:39.722076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0362cf43-b73d-47ef-bb79-652235fdf2c5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:39.874496 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-0362cf43-b73d-47ef-bb79-652235fdf2c5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:39.882731 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-0362cf43-b73d-47ef-bb79-652235fdf2c5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.178949 Oct 24 13:26:39.883561 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 123/242] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:39 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:40.079966 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a6acd2e0-64d0-4e92-a999-19cbfdb8cfd2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:40.080968 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a6acd2e0-64d0-4e92-a999-19cbfdb8cfd2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:40.087644 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a6acd2e0-64d0-4e92-a999-19cbfdb8cfd2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:40.088135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a6acd2e0-64d0-4e92-a999-19cbfdb8cfd2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:40.089249 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a6acd2e0-64d0-4e92-a999-19cbfdb8cfd2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:40.089363 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a6acd2e0-64d0-4e92-a999-19cbfdb8cfd2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:40.089747 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a6acd2e0-64d0-4e92-a999-19cbfdb8cfd2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:40.090394 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a6acd2e0-64d0-4e92-a999-19cbfdb8cfd2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:40.342695 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-cd47de80-67ac-427d-97de-ecab7f580432 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:40.348480 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-cd47de80-67ac-427d-97de-ecab7f580432 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:40.348626 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a6acd2e0-64d0-4e92-a999-19cbfdb8cfd2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:40.354512 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a6acd2e0-64d0-4e92-a999-19cbfdb8cfd2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.278996 Oct 24 13:26:40.355601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 120/243] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:40 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:40.365621 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cd47de80-67ac-427d-97de-ecab7f580432 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:40.366918 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cd47de80-67ac-427d-97de-ecab7f580432 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:40.367502 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cd47de80-67ac-427d-97de-ecab7f580432 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:40.368748 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cd47de80-67ac-427d-97de-ecab7f580432 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:40.369408 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cd47de80-67ac-427d-97de-ecab7f580432 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:40.370000 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cd47de80-67ac-427d-97de-ecab7f580432 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:40.506796 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-cd47de80-67ac-427d-97de-ecab7f580432 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:40.514390 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-cd47de80-67ac-427d-97de-ecab7f580432 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.176749 Oct 24 13:26:40.514959 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 124/244] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:40 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:40.564571 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-efeba0d3-2b59-447a-af18-09276412830e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:40.565176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-efeba0d3-2b59-447a-af18-09276412830e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:40.571211 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-efeba0d3-2b59-447a-af18-09276412830e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:40.571683 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-efeba0d3-2b59-447a-af18-09276412830e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:40.572110 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-efeba0d3-2b59-447a-af18-09276412830e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:40.577065 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-efeba0d3-2b59-447a-af18-09276412830e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:40.577065 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-efeba0d3-2b59-447a-af18-09276412830e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:40.577065 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-efeba0d3-2b59-447a-af18-09276412830e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:40.707420 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-efeba0d3-2b59-447a-af18-09276412830e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:40.716304 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-efeba0d3-2b59-447a-af18-09276412830e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:40.717740 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-efeba0d3-2b59-447a-af18-09276412830e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:40.718857 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-efeba0d3-2b59-447a-af18-09276412830e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.158088 Oct 24 13:26:40.719446 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 121/245] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:40 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:40.906131 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-72b84e06-1a5a-4d59-be17-06c9e20c60d1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:40.906773 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-72b84e06-1a5a-4d59-be17-06c9e20c60d1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:40.912720 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72b84e06-1a5a-4d59-be17-06c9e20c60d1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:40.914005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72b84e06-1a5a-4d59-be17-06c9e20c60d1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:40.914441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72b84e06-1a5a-4d59-be17-06c9e20c60d1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:40.915187 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72b84e06-1a5a-4d59-be17-06c9e20c60d1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:40.915631 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72b84e06-1a5a-4d59-be17-06c9e20c60d1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:40.916046 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72b84e06-1a5a-4d59-be17-06c9e20c60d1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:40.920104 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=100 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:41.044979 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-72b84e06-1a5a-4d59-be17-06c9e20c60d1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:41.054541 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-72b84e06-1a5a-4d59-be17-06c9e20c60d1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.152326 Oct 24 13:26:41.055113 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 125/246] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:40 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:41.378988 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-05f2da5d-b9e0-4455-9691-e3e351c4b8cf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:41.379512 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-05f2da5d-b9e0-4455-9691-e3e351c4b8cf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:41.385970 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-05f2da5d-b9e0-4455-9691-e3e351c4b8cf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:41.386441 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-05f2da5d-b9e0-4455-9691-e3e351c4b8cf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:41.386865 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-05f2da5d-b9e0-4455-9691-e3e351c4b8cf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:41.387535 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-05f2da5d-b9e0-4455-9691-e3e351c4b8cf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:41.387979 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-05f2da5d-b9e0-4455-9691-e3e351c4b8cf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:41.388428 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-05f2da5d-b9e0-4455-9691-e3e351c4b8cf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:41.520498 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-05f2da5d-b9e0-4455-9691-e3e351c4b8cf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:41.531105 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-05f2da5d-b9e0-4455-9691-e3e351c4b8cf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.155892 Oct 24 13:26:41.532261 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 122/247] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:41 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:41.538579 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-2c556344-de59-43e1-9b5a-58262070a7df tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:41.539158 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-2c556344-de59-43e1-9b5a-58262070a7df tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:41.545187 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2c556344-de59-43e1-9b5a-58262070a7df tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:41.545659 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2c556344-de59-43e1-9b5a-58262070a7df tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:41.546425 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2c556344-de59-43e1-9b5a-58262070a7df tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:41.547288 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2c556344-de59-43e1-9b5a-58262070a7df tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:41.547730 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2c556344-de59-43e1-9b5a-58262070a7df tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:41.548154 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2c556344-de59-43e1-9b5a-58262070a7df tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:41.690908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-2c556344-de59-43e1-9b5a-58262070a7df tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:41.693343 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-44065706-54d0-42e3-be67-8ff15ec7deb5 req-8ada8020-09ea-4353-ab17-35585a0b3926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a568b3c6-b364-45d0-a9fa-2bdbde43ccaa", "name": "network-vif-plugged", "status": "completed", "tag": "bdec5a38-0967-442c-8d70-b3f416f6105f"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:26:41.702378 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-2c556344-de59-43e1-9b5a-58262070a7df tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.168846 Oct 24 13:26:41.706445 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-44065706-54d0-42e3-be67-8ff15ec7deb5 req-8ada8020-09ea-4353-ab17-35585a0b3926 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:41.706911 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-44065706-54d0-42e3-be67-8ff15ec7deb5 req-8ada8020-09ea-4353-ab17-35585a0b3926 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:41.707327 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-44065706-54d0-42e3-be67-8ff15ec7deb5 req-8ada8020-09ea-4353-ab17-35585a0b3926 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:41.717318 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 126/248] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:41 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:41.733070 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-44065706-54d0-42e3-be67-8ff15ec7deb5 req-8ada8020-09ea-4353-ab17-35585a0b3926 service nova] Creating event network-vif-plugged:bdec5a38-0967-442c-8d70-b3f416f6105f for instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa on hv-cinder-86249 Oct 24 13:26:41.739363 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-44065706-54d0-42e3-be67-8ff15ec7deb5 req-8ada8020-09ea-4353-ab17-35585a0b3926 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048452 Oct 24 13:26:41.739363 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 123/249] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:26:41.745307 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c6552211-19e7-4b3a-910d-3d544e93156c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:41.745914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c6552211-19e7-4b3a-910d-3d544e93156c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:41.751869 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c6552211-19e7-4b3a-910d-3d544e93156c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:41.752384 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c6552211-19e7-4b3a-910d-3d544e93156c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:41.752815 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c6552211-19e7-4b3a-910d-3d544e93156c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:41.753533 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c6552211-19e7-4b3a-910d-3d544e93156c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:41.754053 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c6552211-19e7-4b3a-910d-3d544e93156c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:41.754643 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c6552211-19e7-4b3a-910d-3d544e93156c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:41.886808 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c6552211-19e7-4b3a-910d-3d544e93156c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:41.897608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c6552211-19e7-4b3a-910d-3d544e93156c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:41.899238 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c6552211-19e7-4b3a-910d-3d544e93156c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:41.900828 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c6552211-19e7-4b3a-910d-3d544e93156c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1405 microversion: 2.20 time: 0.159937 Oct 24 13:26:41.908982 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 127/250] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:41 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:42.078704 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-537694c3-69f1-422b-9ade-83ad3ba405e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:42.079415 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-537694c3-69f1-422b-9ade-83ad3ba405e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:42.085942 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-537694c3-69f1-422b-9ade-83ad3ba405e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:42.086423 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-537694c3-69f1-422b-9ade-83ad3ba405e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:42.086850 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-537694c3-69f1-422b-9ade-83ad3ba405e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:42.087530 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-537694c3-69f1-422b-9ade-83ad3ba405e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:42.087979 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-537694c3-69f1-422b-9ade-83ad3ba405e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:42.088504 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-537694c3-69f1-422b-9ade-83ad3ba405e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:42.287527 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-537694c3-69f1-422b-9ade-83ad3ba405e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:42.287527 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-537694c3-69f1-422b-9ade-83ad3ba405e6 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.152390 Oct 24 13:26:42.287527 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 124/251] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:42 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:42.553376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8c16501f-d427-48f1-88e2-0f123176e8bd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:42.553943 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8c16501f-d427-48f1-88e2-0f123176e8bd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:42.560162 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c16501f-d427-48f1-88e2-0f123176e8bd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:42.560684 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c16501f-d427-48f1-88e2-0f123176e8bd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:42.561117 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c16501f-d427-48f1-88e2-0f123176e8bd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:42.561799 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c16501f-d427-48f1-88e2-0f123176e8bd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:42.562248 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c16501f-d427-48f1-88e2-0f123176e8bd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:42.562670 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c16501f-d427-48f1-88e2-0f123176e8bd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:42.690776 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8c16501f-d427-48f1-88e2-0f123176e8bd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:42.699203 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8c16501f-d427-48f1-88e2-0f123176e8bd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.149896 Oct 24 13:26:42.699809 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 128/252] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:42 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:42.726843 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-10d1b4ea-ee1b-46bc-807d-bb58c5b034bd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:42.727458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-10d1b4ea-ee1b-46bc-807d-bb58c5b034bd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:42.733309 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-10d1b4ea-ee1b-46bc-807d-bb58c5b034bd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:42.733916 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-10d1b4ea-ee1b-46bc-807d-bb58c5b034bd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:42.734180 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-10d1b4ea-ee1b-46bc-807d-bb58c5b034bd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:42.734847 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-10d1b4ea-ee1b-46bc-807d-bb58c5b034bd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:42.735280 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-10d1b4ea-ee1b-46bc-807d-bb58c5b034bd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:42.735687 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-10d1b4ea-ee1b-46bc-807d-bb58c5b034bd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:42.740752 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=100 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:42.876367 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-10d1b4ea-ee1b-46bc-807d-bb58c5b034bd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:42.884573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-10d1b4ea-ee1b-46bc-807d-bb58c5b034bd tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.161444 Oct 24 13:26:42.885143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 125/253] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:42 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:42.927288 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-039eae75-9181-4147-803f-abf7f7ac52b0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:42.927886 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-039eae75-9181-4147-803f-abf7f7ac52b0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:42.934841 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-039eae75-9181-4147-803f-abf7f7ac52b0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:42.936767 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-039eae75-9181-4147-803f-abf7f7ac52b0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:42.936767 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-039eae75-9181-4147-803f-abf7f7ac52b0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:42.936767 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-039eae75-9181-4147-803f-abf7f7ac52b0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:42.937102 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-039eae75-9181-4147-803f-abf7f7ac52b0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:42.937573 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-039eae75-9181-4147-803f-abf7f7ac52b0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:43.067082 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-039eae75-9181-4147-803f-abf7f7ac52b0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:43.075194 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-039eae75-9181-4147-803f-abf7f7ac52b0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:43.076655 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-039eae75-9181-4147-803f-abf7f7ac52b0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:43.077794 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-039eae75-9181-4147-803f-abf7f7ac52b0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1597 microversion: 2.20 time: 0.154842 Oct 24 13:26:43.078348 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 129/254] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:26:42 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1597 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:26:43.104527 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b5cdcffd-9367-4e4a-a029-ce7633fafe07 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:43.105014 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b5cdcffd-9367-4e4a-a029-ce7633fafe07 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:43.111039 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b5cdcffd-9367-4e4a-a029-ce7633fafe07 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:43.111508 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b5cdcffd-9367-4e4a-a029-ce7633fafe07 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:43.111929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b5cdcffd-9367-4e4a-a029-ce7633fafe07 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:43.112661 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b5cdcffd-9367-4e4a-a029-ce7633fafe07 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:43.113101 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b5cdcffd-9367-4e4a-a029-ce7633fafe07 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:43.113512 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b5cdcffd-9367-4e4a-a029-ce7633fafe07 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:43.228319 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b5cdcffd-9367-4e4a-a029-ce7633fafe07 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.128244 Oct 24 13:26:43.228943 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 126/255] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Oct 24 13:26:43 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:26:43.249429 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-31467c8a-bdee-423c-a468-6ec40fab1e78 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:43.250102 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-31467c8a-bdee-423c-a468-6ec40fab1e78 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:43.256155 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31467c8a-bdee-423c-a468-6ec40fab1e78 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:43.256871 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31467c8a-bdee-423c-a468-6ec40fab1e78 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:43.257367 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31467c8a-bdee-423c-a468-6ec40fab1e78 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:43.258138 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31467c8a-bdee-423c-a468-6ec40fab1e78 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:43.258785 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31467c8a-bdee-423c-a468-6ec40fab1e78 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:43.259272 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31467c8a-bdee-423c-a468-6ec40fab1e78 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:43.397024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-31467c8a-bdee-423c-a468-6ec40fab1e78 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:43.407105 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-31467c8a-bdee-423c-a468-6ec40fab1e78 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.161908 Oct 24 13:26:43.407697 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 130/256] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:43 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:43.722875 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-d71ec95f-c3f6-4b70-8861-e4c0768b4268 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:43.723479 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-d71ec95f-c3f6-4b70-8861-e4c0768b4268 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:43.729420 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d71ec95f-c3f6-4b70-8861-e4c0768b4268 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:43.729891 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d71ec95f-c3f6-4b70-8861-e4c0768b4268 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:43.730313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d71ec95f-c3f6-4b70-8861-e4c0768b4268 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:43.730993 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d71ec95f-c3f6-4b70-8861-e4c0768b4268 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:43.731435 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d71ec95f-c3f6-4b70-8861-e4c0768b4268 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:43.731849 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d71ec95f-c3f6-4b70-8861-e4c0768b4268 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:43.914390 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-177844ab-29c1-4d8f-a88c-0f6e3a1ad5c9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:43.915087 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-177844ab-29c1-4d8f-a88c-0f6e3a1ad5c9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:43.920967 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-177844ab-29c1-4d8f-a88c-0f6e3a1ad5c9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:43.921417 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-177844ab-29c1-4d8f-a88c-0f6e3a1ad5c9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:43.921839 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-177844ab-29c1-4d8f-a88c-0f6e3a1ad5c9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:43.922504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-177844ab-29c1-4d8f-a88c-0f6e3a1ad5c9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:43.922972 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-177844ab-29c1-4d8f-a88c-0f6e3a1ad5c9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:43.923383 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-177844ab-29c1-4d8f-a88c-0f6e3a1ad5c9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:44.062680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-177844ab-29c1-4d8f-a88c-0f6e3a1ad5c9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:44.069375 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-d71ec95f-c3f6-4b70-8861-e4c0768b4268 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:44.080700 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-177844ab-29c1-4d8f-a88c-0f6e3a1ad5c9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.169734 Oct 24 13:26:44.081280 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 131/257] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:43 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:44.082094 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-d71ec95f-c3f6-4b70-8861-e4c0768b4268 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.362975 Oct 24 13:26:44.096499 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 127/258] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:43 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:44.431701 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f6deff0f-9ff1-418b-950c-8b52b8962c0c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:44.432157 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f6deff0f-9ff1-418b-950c-8b52b8962c0c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:44.438444 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f6deff0f-9ff1-418b-950c-8b52b8962c0c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:44.438917 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f6deff0f-9ff1-418b-950c-8b52b8962c0c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:44.439437 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f6deff0f-9ff1-418b-950c-8b52b8962c0c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:44.440246 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f6deff0f-9ff1-418b-950c-8b52b8962c0c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:44.440734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f6deff0f-9ff1-418b-950c-8b52b8962c0c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:44.441400 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f6deff0f-9ff1-418b-950c-8b52b8962c0c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:44.640074 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f6deff0f-9ff1-418b-950c-8b52b8962c0c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:44.648185 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f6deff0f-9ff1-418b-950c-8b52b8962c0c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.221098 Oct 24 13:26:44.648771 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 128/259] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:44 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:44.734943 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-666a5858-2506-4f4c-a9d2-35acea7bad36 req-201f71c6-e32a-4680-adc1-1cf1de995dfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d04bbb-034d-4cf1-a753-9c4cb48e92bd", "tag": "4dfc7079-30d9-488d-9dfc-1df75d250b32"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:26:44.744601 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-666a5858-2506-4f4c-a9d2-35acea7bad36 req-201f71c6-e32a-4680-adc1-1cf1de995dfb service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:44.745067 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-666a5858-2506-4f4c-a9d2-35acea7bad36 req-201f71c6-e32a-4680-adc1-1cf1de995dfb service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:44.745479 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-666a5858-2506-4f4c-a9d2-35acea7bad36 req-201f71c6-e32a-4680-adc1-1cf1de995dfb service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:44.756391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-666a5858-2506-4f4c-a9d2-35acea7bad36 req-201f71c6-e32a-4680-adc1-1cf1de995dfb service nova] Creating event network-changed:4dfc7079-30d9-488d-9dfc-1df75d250b32 for instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd on hv-cinder-86249 Oct 24 13:26:44.761810 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-666a5858-2506-4f4c-a9d2-35acea7bad36 req-201f71c6-e32a-4680-adc1-1cf1de995dfb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030406 Oct 24 13:26:44.762393 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 132/260] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:26:45.102840 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e1f35b85-c46d-4b30-878e-d0b27181d43e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:45.108173 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e1f35b85-c46d-4b30-878e-d0b27181d43e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:45.109684 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e1f35b85-c46d-4b30-878e-d0b27181d43e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:45.110168 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e1f35b85-c46d-4b30-878e-d0b27181d43e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:45.110598 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e1f35b85-c46d-4b30-878e-d0b27181d43e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:45.111288 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e1f35b85-c46d-4b30-878e-d0b27181d43e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:45.111388 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-134558c4-6fb1-4126-b0f4-880e123d6b4f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:45.111781 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e1f35b85-c46d-4b30-878e-d0b27181d43e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:45.112061 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-134558c4-6fb1-4126-b0f4-880e123d6b4f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:45.112193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e1f35b85-c46d-4b30-878e-d0b27181d43e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:45.118147 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-134558c4-6fb1-4126-b0f4-880e123d6b4f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:45.118619 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-134558c4-6fb1-4126-b0f4-880e123d6b4f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:45.119038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-134558c4-6fb1-4126-b0f4-880e123d6b4f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:45.119716 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-134558c4-6fb1-4126-b0f4-880e123d6b4f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:45.120159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-134558c4-6fb1-4126-b0f4-880e123d6b4f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:45.120609 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-134558c4-6fb1-4126-b0f4-880e123d6b4f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:45.265910 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-134558c4-6fb1-4126-b0f4-880e123d6b4f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:45.274907 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-134558c4-6fb1-4126-b0f4-880e123d6b4f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.167427 Oct 24 13:26:45.275496 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 133/261] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:45 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:45.451744 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e1f35b85-c46d-4b30-878e-d0b27181d43e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:45.461330 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e1f35b85-c46d-4b30-878e-d0b27181d43e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.362174 Oct 24 13:26:45.461926 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 129/262] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:45 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:45.672336 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f1c4fedd-ce90-4bff-85c2-3ee4bdd4a313 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:45.672948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f1c4fedd-ce90-4bff-85c2-3ee4bdd4a313 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:45.678923 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f1c4fedd-ce90-4bff-85c2-3ee4bdd4a313 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:45.679454 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f1c4fedd-ce90-4bff-85c2-3ee4bdd4a313 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:45.679825 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f1c4fedd-ce90-4bff-85c2-3ee4bdd4a313 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:45.680535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f1c4fedd-ce90-4bff-85c2-3ee4bdd4a313 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:45.680981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f1c4fedd-ce90-4bff-85c2-3ee4bdd4a313 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:45.681394 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f1c4fedd-ce90-4bff-85c2-3ee4bdd4a313 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:45.808738 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f1c4fedd-ce90-4bff-85c2-3ee4bdd4a313 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:45.816455 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f1c4fedd-ce90-4bff-85c2-3ee4bdd4a313 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1314 microversion: 2.1 time: 0.147946 Oct 24 13:26:45.817555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 134/263] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:45 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:46.297881 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f6e79e6f-ac7e-496c-882c-411321b38edc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:46.298419 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f6e79e6f-ac7e-496c-882c-411321b38edc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:46.305107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f6e79e6f-ac7e-496c-882c-411321b38edc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:46.305579 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f6e79e6f-ac7e-496c-882c-411321b38edc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:46.306000 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f6e79e6f-ac7e-496c-882c-411321b38edc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:46.306668 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f6e79e6f-ac7e-496c-882c-411321b38edc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:46.307111 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f6e79e6f-ac7e-496c-882c-411321b38edc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:46.307519 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f6e79e6f-ac7e-496c-882c-411321b38edc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:46.483221 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-eed65519-fdde-425d-9fcd-f1906767f59c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:46.483848 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-eed65519-fdde-425d-9fcd-f1906767f59c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:46.490611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eed65519-fdde-425d-9fcd-f1906767f59c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:46.491830 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eed65519-fdde-425d-9fcd-f1906767f59c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:46.492257 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eed65519-fdde-425d-9fcd-f1906767f59c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:46.493682 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eed65519-fdde-425d-9fcd-f1906767f59c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:46.494291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eed65519-fdde-425d-9fcd-f1906767f59c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:46.494764 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eed65519-fdde-425d-9fcd-f1906767f59c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:46.571607 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f6e79e6f-ac7e-496c-882c-411321b38edc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:46.581854 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f6e79e6f-ac7e-496c-882c-411321b38edc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.287755 Oct 24 13:26:46.582752 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 130/264] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:46 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:46.638098 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-eed65519-fdde-425d-9fcd-f1906767f59c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:46.646062 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-eed65519-fdde-425d-9fcd-f1906767f59c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.166823 Oct 24 13:26:46.646960 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 135/265] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:46 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:46.840616 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-3eebb2cd-2e3b-4868-bd17-d857526b1b71 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:46.841191 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-3eebb2cd-2e3b-4868-bd17-d857526b1b71 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:46.847326 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3eebb2cd-2e3b-4868-bd17-d857526b1b71 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:46.847808 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3eebb2cd-2e3b-4868-bd17-d857526b1b71 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:46.848236 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3eebb2cd-2e3b-4868-bd17-d857526b1b71 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:46.848949 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3eebb2cd-2e3b-4868-bd17-d857526b1b71 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:46.849505 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3eebb2cd-2e3b-4868-bd17-d857526b1b71 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:46.849832 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3eebb2cd-2e3b-4868-bd17-d857526b1b71 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:46.983490 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-3eebb2cd-2e3b-4868-bd17-d857526b1b71 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:46.993324 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-3eebb2cd-2e3b-4868-bd17-d857526b1b71 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1501 microversion: 2.1 time: 0.156632 Oct 24 13:26:46.994713 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 131/266] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:46 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:47.603793 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-10607dec-4ab5-4309-8611-22c8c800367a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:47.604429 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-10607dec-4ab5-4309-8611-22c8c800367a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:47.607527 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=100 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:47.610963 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-10607dec-4ab5-4309-8611-22c8c800367a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:47.611475 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-10607dec-4ab5-4309-8611-22c8c800367a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:47.611905 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-10607dec-4ab5-4309-8611-22c8c800367a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:47.612612 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-10607dec-4ab5-4309-8611-22c8c800367a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:47.613053 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-10607dec-4ab5-4309-8611-22c8c800367a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:47.613465 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-10607dec-4ab5-4309-8611-22c8c800367a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:47.668479 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-28f916b0-ae82-49c1-af2e-dc045491fa52 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:47.669087 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-28f916b0-ae82-49c1-af2e-dc045491fa52 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:47.675340 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-28f916b0-ae82-49c1-af2e-dc045491fa52 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:47.675823 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-28f916b0-ae82-49c1-af2e-dc045491fa52 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:47.676248 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-28f916b0-ae82-49c1-af2e-dc045491fa52 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:47.676977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-28f916b0-ae82-49c1-af2e-dc045491fa52 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:47.677420 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-28f916b0-ae82-49c1-af2e-dc045491fa52 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:47.677833 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-28f916b0-ae82-49c1-af2e-dc045491fa52 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:47.796716 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-10607dec-4ab5-4309-8611-22c8c800367a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:47.808182 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-10607dec-4ab5-4309-8611-22c8c800367a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.206817 Oct 24 13:26:47.811476 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 136/267] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:47 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:47.863602 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-28f916b0-ae82-49c1-af2e-dc045491fa52 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:47.871830 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-28f916b0-ae82-49c1-af2e-dc045491fa52 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.207304 Oct 24 13:26:47.872422 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 132/268] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:47 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:48.833312 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bd5ccaed-822a-4eb0-8a16-81f3e14d833d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:48.833928 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bd5ccaed-822a-4eb0-8a16-81f3e14d833d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:48.840577 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bd5ccaed-822a-4eb0-8a16-81f3e14d833d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:48.841057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bd5ccaed-822a-4eb0-8a16-81f3e14d833d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:48.841487 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bd5ccaed-822a-4eb0-8a16-81f3e14d833d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:48.842161 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bd5ccaed-822a-4eb0-8a16-81f3e14d833d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:48.842610 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bd5ccaed-822a-4eb0-8a16-81f3e14d833d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:48.843026 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bd5ccaed-822a-4eb0-8a16-81f3e14d833d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:48.894256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-67f200dc-f5cd-426b-9850-dc22c3af5c50 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:48.894857 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-67f200dc-f5cd-426b-9850-dc22c3af5c50 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:48.901521 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-67f200dc-f5cd-426b-9850-dc22c3af5c50 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:48.902004 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-67f200dc-f5cd-426b-9850-dc22c3af5c50 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:48.902434 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-67f200dc-f5cd-426b-9850-dc22c3af5c50 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:48.903114 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-67f200dc-f5cd-426b-9850-dc22c3af5c50 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:48.903560 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-67f200dc-f5cd-426b-9850-dc22c3af5c50 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:48.903972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-67f200dc-f5cd-426b-9850-dc22c3af5c50 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:48.975934 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-bd5ccaed-822a-4eb0-8a16-81f3e14d833d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:48.987389 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-bd5ccaed-822a-4eb0-8a16-81f3e14d833d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.154397 Oct 24 13:26:48.987389 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 137/269] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:48 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:49.037347 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-67f200dc-f5cd-426b-9850-dc22c3af5c50 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:49.045540 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-67f200dc-f5cd-426b-9850-dc22c3af5c50 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.155068 Oct 24 13:26:49.046182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 133/270] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:48 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:50.008247 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9852afde-1614-42be-8f04-ae0dadc0228e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:50.008869 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-9852afde-1614-42be-8f04-ae0dadc0228e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:50.014735 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9852afde-1614-42be-8f04-ae0dadc0228e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:50.015203 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9852afde-1614-42be-8f04-ae0dadc0228e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:50.015625 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9852afde-1614-42be-8f04-ae0dadc0228e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:50.016307 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9852afde-1614-42be-8f04-ae0dadc0228e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:50.016754 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9852afde-1614-42be-8f04-ae0dadc0228e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:50.017166 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9852afde-1614-42be-8f04-ae0dadc0228e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:50.068518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b6790b7a-fda1-4d49-9431-ca03b5f6fafb tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:50.071081 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b6790b7a-fda1-4d49-9431-ca03b5f6fafb tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:50.075536 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6790b7a-fda1-4d49-9431-ca03b5f6fafb tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:50.076008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6790b7a-fda1-4d49-9431-ca03b5f6fafb tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:50.076465 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6790b7a-fda1-4d49-9431-ca03b5f6fafb tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:50.077141 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6790b7a-fda1-4d49-9431-ca03b5f6fafb tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:50.077583 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6790b7a-fda1-4d49-9431-ca03b5f6fafb tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:50.077993 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6790b7a-fda1-4d49-9431-ca03b5f6fafb tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:50.175798 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-9852afde-1614-42be-8f04-ae0dadc0228e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:50.183746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9852afde-1614-42be-8f04-ae0dadc0228e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.179284 Oct 24 13:26:50.191342 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 138/271] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:50 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:50.232093 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b6790b7a-fda1-4d49-9431-ca03b5f6fafb tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:50.239630 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b6790b7a-fda1-4d49-9431-ca03b5f6fafb tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.174934 Oct 24 13:26:50.240186 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 134/272] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:50 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:51.211592 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-fc7b10da-efa7-4aa9-bbb0-04ccd80ad669 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:51.211592 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-fc7b10da-efa7-4aa9-bbb0-04ccd80ad669 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:51.216253 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc7b10da-efa7-4aa9-bbb0-04ccd80ad669 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:51.216820 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc7b10da-efa7-4aa9-bbb0-04ccd80ad669 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:51.217251 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc7b10da-efa7-4aa9-bbb0-04ccd80ad669 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:51.217933 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc7b10da-efa7-4aa9-bbb0-04ccd80ad669 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:51.218563 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc7b10da-efa7-4aa9-bbb0-04ccd80ad669 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:51.219267 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc7b10da-efa7-4aa9-bbb0-04ccd80ad669 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:51.263981 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e8c190ab-df07-4918-9f51-3c9b3059fd20 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:51.264533 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e8c190ab-df07-4918-9f51-3c9b3059fd20 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:51.266449 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=95 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:51.271272 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e8c190ab-df07-4918-9f51-3c9b3059fd20 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:51.271742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e8c190ab-df07-4918-9f51-3c9b3059fd20 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:51.272758 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e8c190ab-df07-4918-9f51-3c9b3059fd20 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:51.273462 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e8c190ab-df07-4918-9f51-3c9b3059fd20 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:51.273947 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e8c190ab-df07-4918-9f51-3c9b3059fd20 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:51.274335 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e8c190ab-df07-4918-9f51-3c9b3059fd20 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:51.369555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fc7b10da-efa7-4aa9-bbb0-04ccd80ad669 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:51.377980 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-fc7b10da-efa7-4aa9-bbb0-04ccd80ad669 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.174985 Oct 24 13:26:51.378556 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 139/273] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:51 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:51.614606 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e8c190ab-df07-4918-9f51-3c9b3059fd20 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:51.622290 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e8c190ab-df07-4918-9f51-3c9b3059fd20 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.362240 Oct 24 13:26:51.622862 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 135/274] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:51 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:52.400809 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a4031914-be96-4341-b6c5-8f3a921ac7d9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:52.401441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a4031914-be96-4341-b6c5-8f3a921ac7d9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:52.407314 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a4031914-be96-4341-b6c5-8f3a921ac7d9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:52.407783 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a4031914-be96-4341-b6c5-8f3a921ac7d9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:52.408206 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a4031914-be96-4341-b6c5-8f3a921ac7d9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:52.408907 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a4031914-be96-4341-b6c5-8f3a921ac7d9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:52.409353 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a4031914-be96-4341-b6c5-8f3a921ac7d9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:52.409770 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a4031914-be96-4341-b6c5-8f3a921ac7d9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:52.538358 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a4031914-be96-4341-b6c5-8f3a921ac7d9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:52.545856 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a4031914-be96-4341-b6c5-8f3a921ac7d9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.149069 Oct 24 13:26:52.546415 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 140/275] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:52 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:52.645822 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c441a443-eb65-46e0-9607-1d7ab90eb6ce tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:52.647720 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-c441a443-eb65-46e0-9607-1d7ab90eb6ce tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:52.654011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c441a443-eb65-46e0-9607-1d7ab90eb6ce tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:52.654492 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c441a443-eb65-46e0-9607-1d7ab90eb6ce tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:52.654916 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c441a443-eb65-46e0-9607-1d7ab90eb6ce tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:52.655611 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c441a443-eb65-46e0-9607-1d7ab90eb6ce tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:52.656058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c441a443-eb65-46e0-9607-1d7ab90eb6ce tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:52.656507 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c441a443-eb65-46e0-9607-1d7ab90eb6ce tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:52.817976 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c441a443-eb65-46e0-9607-1d7ab90eb6ce tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:52.825510 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-c441a443-eb65-46e0-9607-1d7ab90eb6ce tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.183633 Oct 24 13:26:52.826065 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 136/276] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:52 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:53.031604 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-df23f4dc-d6e4-43d1-8ed0-a417eabf2f50 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "246feb1d-b387-4b40-a9f2-511ec12c82db"}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:26:53.033937 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-df23f4dc-d6e4-43d1-8ed0-a417eabf2f50 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:53.040685 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-df23f4dc-d6e4-43d1-8ed0-a417eabf2f50 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:53.041100 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-df23f4dc-d6e4-43d1-8ed0-a417eabf2f50 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:53.041521 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-df23f4dc-d6e4-43d1-8ed0-a417eabf2f50 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:53.042184 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-df23f4dc-d6e4-43d1-8ed0-a417eabf2f50 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:53.042625 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-df23f4dc-d6e4-43d1-8ed0-a417eabf2f50 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:53.043029 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-df23f4dc-d6e4-43d1-8ed0-a417eabf2f50 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:53.574295 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-34cbd5a8-a97c-4025-8393-6f8cc75968f3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:53.575070 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-34cbd5a8-a97c-4025-8393-6f8cc75968f3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:53.581473 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34cbd5a8-a97c-4025-8393-6f8cc75968f3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:53.581865 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34cbd5a8-a97c-4025-8393-6f8cc75968f3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:53.584912 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34cbd5a8-a97c-4025-8393-6f8cc75968f3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:53.585630 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34cbd5a8-a97c-4025-8393-6f8cc75968f3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:53.586091 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34cbd5a8-a97c-4025-8393-6f8cc75968f3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:53.586516 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34cbd5a8-a97c-4025-8393-6f8cc75968f3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:53.722865 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-34cbd5a8-a97c-4025-8393-6f8cc75968f3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:53.730756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-34cbd5a8-a97c-4025-8393-6f8cc75968f3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1322 microversion: 2.1 time: 0.164205 Oct 24 13:26:53.731335 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 137/277] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:53 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:53.849749 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-aa792cff-9d3d-4c93-aca1-8ae213d9053d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:53.852138 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-aa792cff-9d3d-4c93-aca1-8ae213d9053d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:53.856946 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-aa792cff-9d3d-4c93-aca1-8ae213d9053d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:53.857498 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-aa792cff-9d3d-4c93-aca1-8ae213d9053d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:53.857884 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-aa792cff-9d3d-4c93-aca1-8ae213d9053d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:53.858566 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-aa792cff-9d3d-4c93-aca1-8ae213d9053d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:53.859013 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-aa792cff-9d3d-4c93-aca1-8ae213d9053d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:53.859428 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-aa792cff-9d3d-4c93-aca1-8ae213d9053d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:54.061708 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-aa792cff-9d3d-4c93-aca1-8ae213d9053d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:54.070997 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-aa792cff-9d3d-4c93-aca1-8ae213d9053d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1363 microversion: 2.1 time: 0.224858 Oct 24 13:26:54.071599 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 138/278] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:53 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:26:54.754207 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-fcec0612-b5c0-4d94-95d4-f6a61d21c954 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:54.754879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-fcec0612-b5c0-4d94-95d4-f6a61d21c954 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:54.762270 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fcec0612-b5c0-4d94-95d4-f6a61d21c954 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:54.763108 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fcec0612-b5c0-4d94-95d4-f6a61d21c954 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:54.763539 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fcec0612-b5c0-4d94-95d4-f6a61d21c954 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:54.764228 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fcec0612-b5c0-4d94-95d4-f6a61d21c954 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:54.764771 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fcec0612-b5c0-4d94-95d4-f6a61d21c954 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:54.765173 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fcec0612-b5c0-4d94-95d4-f6a61d21c954 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:54.907301 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-fcec0612-b5c0-4d94-95d4-f6a61d21c954 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:54.915205 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-fcec0612-b5c0-4d94-95d4-f6a61d21c954 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1515 microversion: 2.1 time: 0.164848 Oct 24 13:26:54.915861 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 139/279] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:54 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:54.939274 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-41b4aebb-3c70-4b6b-a2b2-27670cdcc012 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:26:54.941611 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-41b4aebb-3c70-4b6b-a2b2-27670cdcc012 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:54.950113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-41b4aebb-3c70-4b6b-a2b2-27670cdcc012 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:54.950597 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-41b4aebb-3c70-4b6b-a2b2-27670cdcc012 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:54.951039 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-41b4aebb-3c70-4b6b-a2b2-27670cdcc012 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:54.951768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-41b4aebb-3c70-4b6b-a2b2-27670cdcc012 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:54.952215 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-41b4aebb-3c70-4b6b-a2b2-27670cdcc012 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:54.952649 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-41b4aebb-3c70-4b6b-a2b2-27670cdcc012 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:54.977162 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.objects.instance [None req-41b4aebb-3c70-4b6b-a2b2-27670cdcc012 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lazy-loading 'flavor' on Instance uuid 8de4c382-e12d-4068-96c2-58d44e5265db {{(pid=119145) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:26:55.136387 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:55.253105 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:26:55.366657 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-41b4aebb-3c70-4b6b-a2b2-27670cdcc012 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "POST /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db/action" status: 200 len: 32 microversion: 2.1 time: 0.430612 Oct 24 13:26:55.367277 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 140/280] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 24 13:26:54 2022] POST /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db/action => generated 32 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:26:55.372455 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6334d063-f48c-46e1-9b8e-33282bcfbf60 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:55.373169 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-6334d063-f48c-46e1-9b8e-33282bcfbf60 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:55.379201 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6334d063-f48c-46e1-9b8e-33282bcfbf60 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:55.379701 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6334d063-f48c-46e1-9b8e-33282bcfbf60 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:55.380111 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6334d063-f48c-46e1-9b8e-33282bcfbf60 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:55.380820 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6334d063-f48c-46e1-9b8e-33282bcfbf60 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:55.381292 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6334d063-f48c-46e1-9b8e-33282bcfbf60 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:55.381715 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6334d063-f48c-46e1-9b8e-33282bcfbf60 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:55.432538 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-df23f4dc-d6e4-43d1-8ed0-a417eabf2f50 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "POST /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.404678 Oct 24 13:26:55.442377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 141/281] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 24 13:26:53 2022] POST /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690/os-volume_attachments => generated 194 bytes in 2410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:26:55.444750 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a5f1cb0e-c59c-4f37-b813-7eacf0885f2d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:55.445455 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a5f1cb0e-c59c-4f37-b813-7eacf0885f2d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:55.452142 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a5f1cb0e-c59c-4f37-b813-7eacf0885f2d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:55.452656 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a5f1cb0e-c59c-4f37-b813-7eacf0885f2d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:55.453075 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a5f1cb0e-c59c-4f37-b813-7eacf0885f2d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:55.453769 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a5f1cb0e-c59c-4f37-b813-7eacf0885f2d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:55.454339 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a5f1cb0e-c59c-4f37-b813-7eacf0885f2d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:55.455034 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a5f1cb0e-c59c-4f37-b813-7eacf0885f2d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:55.534441 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-6334d063-f48c-46e1-9b8e-33282bcfbf60 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:55.543751 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6334d063-f48c-46e1-9b8e-33282bcfbf60 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1549 microversion: 2.1 time: 0.175332 Oct 24 13:26:55.546365 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 141/282] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:55 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1549 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:55.574473 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-5db535bb-86d4-4810-a6d8-2910b2353d62 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:55.574978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-5db535bb-86d4-4810-a6d8-2910b2353d62 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:55.582058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5db535bb-86d4-4810-a6d8-2910b2353d62 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:55.582768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5db535bb-86d4-4810-a6d8-2910b2353d62 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:55.583190 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5db535bb-86d4-4810-a6d8-2910b2353d62 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:55.584081 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5db535bb-86d4-4810-a6d8-2910b2353d62 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:55.584613 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5db535bb-86d4-4810-a6d8-2910b2353d62 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:55.585112 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5db535bb-86d4-4810-a6d8-2910b2353d62 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:55.635625 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a5f1cb0e-c59c-4f37-b813-7eacf0885f2d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:55.644129 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a5f1cb0e-c59c-4f37-b813-7eacf0885f2d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.203662 Oct 24 13:26:55.644768 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 142/283] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:55 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:55.669354 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-5db535bb-86d4-4810-a6d8-2910b2353d62 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102411 Oct 24 13:26:55.669950 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 142/284] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 24 13:26:55 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:26:56.671275 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-04575a57-4e4b-4a0b-9ae2-ee790371c49d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:56.671860 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-04575a57-4e4b-4a0b-9ae2-ee790371c49d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:56.682121 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-04575a57-4e4b-4a0b-9ae2-ee790371c49d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:56.682940 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-04575a57-4e4b-4a0b-9ae2-ee790371c49d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:56.683561 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-04575a57-4e4b-4a0b-9ae2-ee790371c49d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:56.684862 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-04575a57-4e4b-4a0b-9ae2-ee790371c49d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:56.685541 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-04575a57-4e4b-4a0b-9ae2-ee790371c49d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:56.685930 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-04575a57-4e4b-4a0b-9ae2-ee790371c49d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:56.880237 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-04575a57-4e4b-4a0b-9ae2-ee790371c49d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:56.892106 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-04575a57-4e4b-4a0b-9ae2-ee790371c49d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.227854 Oct 24 13:26:56.893536 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 143/285] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:56 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:57.469618 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-c7c9aa07-c7e5-412c-a774-421ba7dcb860 req-d8c68b2c-53ab-4170-9a7f-19180bd4e79d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a568b3c6-b364-45d0-a9fa-2bdbde43ccaa", "tag": "bdec5a38-0967-442c-8d70-b3f416f6105f"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:26:57.479296 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-c7c9aa07-c7e5-412c-a774-421ba7dcb860 req-d8c68b2c-53ab-4170-9a7f-19180bd4e79d service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:57.480142 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-c7c9aa07-c7e5-412c-a774-421ba7dcb860 req-d8c68b2c-53ab-4170-9a7f-19180bd4e79d service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:57.480660 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-c7c9aa07-c7e5-412c-a774-421ba7dcb860 req-d8c68b2c-53ab-4170-9a7f-19180bd4e79d service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:57.492640 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-c7c9aa07-c7e5-412c-a774-421ba7dcb860 req-d8c68b2c-53ab-4170-9a7f-19180bd4e79d service nova] Creating event network-changed:bdec5a38-0967-442c-8d70-b3f416f6105f for instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa on hv-cinder-86249 Oct 24 13:26:57.497623 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-c7c9aa07-c7e5-412c-a774-421ba7dcb860 req-d8c68b2c-53ab-4170-9a7f-19180bd4e79d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031494 Oct 24 13:26:57.498221 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 143/286] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:26:57.919270 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-23386e0b-9fab-475e-923b-7fda203392d3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:57.920905 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-23386e0b-9fab-475e-923b-7fda203392d3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:57.929784 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-23386e0b-9fab-475e-923b-7fda203392d3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:57.930537 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-23386e0b-9fab-475e-923b-7fda203392d3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:57.931133 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-23386e0b-9fab-475e-923b-7fda203392d3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:57.932905 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-23386e0b-9fab-475e-923b-7fda203392d3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:57.933732 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-23386e0b-9fab-475e-923b-7fda203392d3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:57.934401 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-23386e0b-9fab-475e-923b-7fda203392d3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:58.443408 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-23386e0b-9fab-475e-923b-7fda203392d3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:58.448126 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-23386e0b-9fab-475e-923b-7fda203392d3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.532645 Oct 24 13:26:58.449139 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 144/287] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:57 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:26:59.473951 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b6079ea8-6a36-4d60-a0b7-b467a24da82c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:26:59.474646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b6079ea8-6a36-4d60-a0b7-b467a24da82c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:26:59.481009 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6079ea8-6a36-4d60-a0b7-b467a24da82c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:59.481484 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6079ea8-6a36-4d60-a0b7-b467a24da82c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:59.482080 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6079ea8-6a36-4d60-a0b7-b467a24da82c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:59.482765 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6079ea8-6a36-4d60-a0b7-b467a24da82c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:26:59.483214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6079ea8-6a36-4d60-a0b7-b467a24da82c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:26:59.483640 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6079ea8-6a36-4d60-a0b7-b467a24da82c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:26:59.629388 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b6079ea8-6a36-4d60-a0b7-b467a24da82c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:26:59.639301 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b6079ea8-6a36-4d60-a0b7-b467a24da82c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.169413 Oct 24 13:26:59.639813 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 144/288] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:26:59 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:00.664103 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-31ca5ae3-1063-4e22-bc8e-cb99ddab9957 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:00.669195 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-31ca5ae3-1063-4e22-bc8e-cb99ddab9957 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:00.671582 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31ca5ae3-1063-4e22-bc8e-cb99ddab9957 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:00.672066 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31ca5ae3-1063-4e22-bc8e-cb99ddab9957 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:00.672519 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31ca5ae3-1063-4e22-bc8e-cb99ddab9957 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:00.673334 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31ca5ae3-1063-4e22-bc8e-cb99ddab9957 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:00.673776 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31ca5ae3-1063-4e22-bc8e-cb99ddab9957 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:00.674202 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-31ca5ae3-1063-4e22-bc8e-cb99ddab9957 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:00.827760 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-31ca5ae3-1063-4e22-bc8e-cb99ddab9957 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:00.836682 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-31ca5ae3-1063-4e22-bc8e-cb99ddab9957 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.176709 Oct 24 13:27:00.837247 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 145/289] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:00 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:27:01.859945 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-728737c4-f13d-48e7-bf05-776b6bb7cf43 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:01.860649 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-728737c4-f13d-48e7-bf05-776b6bb7cf43 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:01.866595 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-728737c4-f13d-48e7-bf05-776b6bb7cf43 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:01.867070 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-728737c4-f13d-48e7-bf05-776b6bb7cf43 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:01.867493 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-728737c4-f13d-48e7-bf05-776b6bb7cf43 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:01.868161 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-728737c4-f13d-48e7-bf05-776b6bb7cf43 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:01.868630 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-728737c4-f13d-48e7-bf05-776b6bb7cf43 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:01.869040 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-728737c4-f13d-48e7-bf05-776b6bb7cf43 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:01.998507 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-728737c4-f13d-48e7-bf05-776b6bb7cf43 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:02.006234 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-728737c4-f13d-48e7-bf05-776b6bb7cf43 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.150169 Oct 24 13:27:02.006797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 145/290] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:01 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:03.028824 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bc2e2be3-0379-47c5-a6c1-7001dd1864e7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:03.029459 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bc2e2be3-0379-47c5-a6c1-7001dd1864e7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:03.035760 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bc2e2be3-0379-47c5-a6c1-7001dd1864e7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:03.036237 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bc2e2be3-0379-47c5-a6c1-7001dd1864e7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:03.036698 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bc2e2be3-0379-47c5-a6c1-7001dd1864e7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:03.037380 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bc2e2be3-0379-47c5-a6c1-7001dd1864e7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:03.037829 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bc2e2be3-0379-47c5-a6c1-7001dd1864e7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:03.038247 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bc2e2be3-0379-47c5-a6c1-7001dd1864e7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:03.170260 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-bc2e2be3-0379-47c5-a6c1-7001dd1864e7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:03.178496 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-bc2e2be3-0379-47c5-a6c1-7001dd1864e7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.153103 Oct 24 13:27:03.179212 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 146/291] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:03 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:04.201497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-4fee953c-74ea-4bf3-98af-a3d39afde8fb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:04.202015 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-4fee953c-74ea-4bf3-98af-a3d39afde8fb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:04.208182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4fee953c-74ea-4bf3-98af-a3d39afde8fb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:04.212932 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4fee953c-74ea-4bf3-98af-a3d39afde8fb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:04.212932 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4fee953c-74ea-4bf3-98af-a3d39afde8fb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:04.212932 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4fee953c-74ea-4bf3-98af-a3d39afde8fb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:04.212932 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4fee953c-74ea-4bf3-98af-a3d39afde8fb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:04.213498 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4fee953c-74ea-4bf3-98af-a3d39afde8fb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:04.346068 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-4fee953c-74ea-4bf3-98af-a3d39afde8fb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:04.354630 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-4fee953c-74ea-4bf3-98af-a3d39afde8fb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.156742 Oct 24 13:27:04.355200 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 146/292] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:04 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:05.378094 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-13668361-301c-4e7d-a9af-3b8d5f1429bd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:05.378806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-13668361-301c-4e7d-a9af-3b8d5f1429bd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:05.385943 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-13668361-301c-4e7d-a9af-3b8d5f1429bd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:05.386429 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-13668361-301c-4e7d-a9af-3b8d5f1429bd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:05.387447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-13668361-301c-4e7d-a9af-3b8d5f1429bd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:05.388348 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-13668361-301c-4e7d-a9af-3b8d5f1429bd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:05.388808 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-13668361-301c-4e7d-a9af-3b8d5f1429bd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:05.389228 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-13668361-301c-4e7d-a9af-3b8d5f1429bd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:05.523625 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-13668361-301c-4e7d-a9af-3b8d5f1429bd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:05.531733 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-13668361-301c-4e7d-a9af-3b8d5f1429bd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.157368 Oct 24 13:27:05.532329 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 147/293] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:05 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:06.555593 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-3d779d98-771b-42ed-a663-159b8df457ef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:06.556194 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-3d779d98-771b-42ed-a663-159b8df457ef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:06.562235 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3d779d98-771b-42ed-a663-159b8df457ef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:06.562709 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3d779d98-771b-42ed-a663-159b8df457ef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:06.563131 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3d779d98-771b-42ed-a663-159b8df457ef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:06.563808 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3d779d98-771b-42ed-a663-159b8df457ef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:06.564249 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3d779d98-771b-42ed-a663-159b8df457ef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:06.564690 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3d779d98-771b-42ed-a663-159b8df457ef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:06.689573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-3d779d98-771b-42ed-a663-159b8df457ef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:06.697359 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-3d779d98-771b-42ed-a663-159b8df457ef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.146394 Oct 24 13:27:06.697929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 147/294] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:06 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:07.720174 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5a4fb6ab-dd77-4667-a289-b35b661398d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:07.720890 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5a4fb6ab-dd77-4667-a289-b35b661398d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:07.727321 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5a4fb6ab-dd77-4667-a289-b35b661398d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:07.727809 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5a4fb6ab-dd77-4667-a289-b35b661398d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:07.728242 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5a4fb6ab-dd77-4667-a289-b35b661398d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:07.728977 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5a4fb6ab-dd77-4667-a289-b35b661398d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:07.729436 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5a4fb6ab-dd77-4667-a289-b35b661398d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:07.729897 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5a4fb6ab-dd77-4667-a289-b35b661398d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:07.859939 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5a4fb6ab-dd77-4667-a289-b35b661398d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:07.867825 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5a4fb6ab-dd77-4667-a289-b35b661398d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.151485 Oct 24 13:27:07.868403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 148/295] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:07 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:08.890435 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c743b24b-4c9d-4417-8919-4549abe20cef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:08.890967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-c743b24b-4c9d-4417-8919-4549abe20cef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:08.896832 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c743b24b-4c9d-4417-8919-4549abe20cef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:08.897303 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c743b24b-4c9d-4417-8919-4549abe20cef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:08.897729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c743b24b-4c9d-4417-8919-4549abe20cef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:08.899000 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c743b24b-4c9d-4417-8919-4549abe20cef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:08.899442 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c743b24b-4c9d-4417-8919-4549abe20cef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:08.899856 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c743b24b-4c9d-4417-8919-4549abe20cef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:09.032905 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c743b24b-4c9d-4417-8919-4549abe20cef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:09.040473 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-c743b24b-4c9d-4417-8919-4549abe20cef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.153865 Oct 24 13:27:09.041034 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 148/296] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:08 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:10.063150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a694566b-84ee-4427-971e-fa3be564475a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:10.063761 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a694566b-84ee-4427-971e-fa3be564475a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:10.070998 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a694566b-84ee-4427-971e-fa3be564475a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:10.071501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a694566b-84ee-4427-971e-fa3be564475a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:10.071958 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a694566b-84ee-4427-971e-fa3be564475a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:10.072687 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a694566b-84ee-4427-971e-fa3be564475a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:10.073235 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a694566b-84ee-4427-971e-fa3be564475a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:10.073655 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a694566b-84ee-4427-971e-fa3be564475a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:10.218822 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a694566b-84ee-4427-971e-fa3be564475a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:10.226597 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a694566b-84ee-4427-971e-fa3be564475a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.167485 Oct 24 13:27:10.227735 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 149/297] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:10 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:10.668642 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-44650534-2c8b-45bd-910c-d8c1e0886222 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:10.669124 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-44650534-2c8b-45bd-910c-d8c1e0886222 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:10.678946 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-44650534-2c8b-45bd-910c-d8c1e0886222 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:10.679801 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-44650534-2c8b-45bd-910c-d8c1e0886222 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:10.681348 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-44650534-2c8b-45bd-910c-d8c1e0886222 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:10.682193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-44650534-2c8b-45bd-910c-d8c1e0886222 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:10.682641 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-44650534-2c8b-45bd-910c-d8c1e0886222 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:10.683247 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-44650534-2c8b-45bd-910c-d8c1e0886222 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:10.710463 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-44650534-2c8b-45bd-910c-d8c1e0886222 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Going to try to terminate instance {{(pid=119145) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:27:10.978687 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-44650534-2c8b-45bd-910c-d8c1e0886222 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "DELETE /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 204 len: 0 microversion: 2.1 time: 0.313593 Oct 24 13:27:10.979273 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 149/298] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:27:10 2022] DELETE /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 13:27:10.987682 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-57e8ff0e-4e33-4117-b858-e4191b64a4ac tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:10.988401 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-57e8ff0e-4e33-4117-b858-e4191b64a4ac tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:10.995096 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-57e8ff0e-4e33-4117-b858-e4191b64a4ac tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:10.995507 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-57e8ff0e-4e33-4117-b858-e4191b64a4ac tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:10.995933 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-57e8ff0e-4e33-4117-b858-e4191b64a4ac tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:10.996645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-57e8ff0e-4e33-4117-b858-e4191b64a4ac tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:10.997094 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-57e8ff0e-4e33-4117-b858-e4191b64a4ac tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:10.997511 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-57e8ff0e-4e33-4117-b858-e4191b64a4ac tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:11.137717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-57e8ff0e-4e33-4117-b858-e4191b64a4ac tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:11.146480 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-57e8ff0e-4e33-4117-b858-e4191b64a4ac tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1553 microversion: 2.1 time: 0.162688 Oct 24 13:27:11.147224 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 150/299] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:10 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:11.251018 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-68be904b-b0b3-46b3-8b7e-a91f2b82a53e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:11.251716 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-68be904b-b0b3-46b3-8b7e-a91f2b82a53e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:11.257708 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-68be904b-b0b3-46b3-8b7e-a91f2b82a53e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:11.258219 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-68be904b-b0b3-46b3-8b7e-a91f2b82a53e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:11.258650 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-68be904b-b0b3-46b3-8b7e-a91f2b82a53e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:11.259325 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-68be904b-b0b3-46b3-8b7e-a91f2b82a53e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:11.259769 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-68be904b-b0b3-46b3-8b7e-a91f2b82a53e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:11.260327 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-68be904b-b0b3-46b3-8b7e-a91f2b82a53e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:11.386063 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-68be904b-b0b3-46b3-8b7e-a91f2b82a53e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:11.393668 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-68be904b-b0b3-46b3-8b7e-a91f2b82a53e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.146977 Oct 24 13:27:11.394236 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 150/300] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:11 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:12.169853 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f1dd3c9b-e6c0-46c8-8cd4-b5ebca791083 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:12.170424 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f1dd3c9b-e6c0-46c8-8cd4-b5ebca791083 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:12.176923 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f1dd3c9b-e6c0-46c8-8cd4-b5ebca791083 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:12.177390 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f1dd3c9b-e6c0-46c8-8cd4-b5ebca791083 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:12.177812 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f1dd3c9b-e6c0-46c8-8cd4-b5ebca791083 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:12.178478 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f1dd3c9b-e6c0-46c8-8cd4-b5ebca791083 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:12.178918 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f1dd3c9b-e6c0-46c8-8cd4-b5ebca791083 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:12.179334 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f1dd3c9b-e6c0-46c8-8cd4-b5ebca791083 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:12.308143 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f1dd3c9b-e6c0-46c8-8cd4-b5ebca791083 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:12.316369 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f1dd3c9b-e6c0-46c8-8cd4-b5ebca791083 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1553 microversion: 2.1 time: 0.150362 Oct 24 13:27:12.321096 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 151/301] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:12 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:12.417031 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-15027fe5-bc42-42a9-9eae-c667714a1084 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:12.417611 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-15027fe5-bc42-42a9-9eae-c667714a1084 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:12.423469 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-15027fe5-bc42-42a9-9eae-c667714a1084 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:12.423935 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-15027fe5-bc42-42a9-9eae-c667714a1084 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:12.424393 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-15027fe5-bc42-42a9-9eae-c667714a1084 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:12.425065 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-15027fe5-bc42-42a9-9eae-c667714a1084 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:12.425507 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-15027fe5-bc42-42a9-9eae-c667714a1084 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:12.425918 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-15027fe5-bc42-42a9-9eae-c667714a1084 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:12.557624 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-15027fe5-bc42-42a9-9eae-c667714a1084 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:12.565375 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-15027fe5-bc42-42a9-9eae-c667714a1084 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.152232 Oct 24 13:27:12.565944 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 151/302] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:12 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:13.340630 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b80ad591-f231-4eaf-8067-ef07460f63e1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:13.341234 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b80ad591-f231-4eaf-8067-ef07460f63e1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:13.347939 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b80ad591-f231-4eaf-8067-ef07460f63e1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:13.348448 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b80ad591-f231-4eaf-8067-ef07460f63e1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:13.348873 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b80ad591-f231-4eaf-8067-ef07460f63e1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:13.349545 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b80ad591-f231-4eaf-8067-ef07460f63e1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:13.349987 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b80ad591-f231-4eaf-8067-ef07460f63e1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:13.350397 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b80ad591-f231-4eaf-8067-ef07460f63e1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:13.483314 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b80ad591-f231-4eaf-8067-ef07460f63e1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:13.491915 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b80ad591-f231-4eaf-8067-ef07460f63e1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1553 microversion: 2.1 time: 0.155592 Oct 24 13:27:13.493183 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 152/303] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:13 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:13.588819 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0ae2c4cd-72a5-4b84-9cfc-e44aaaea6b4f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:13.589437 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0ae2c4cd-72a5-4b84-9cfc-e44aaaea6b4f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:13.595560 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ae2c4cd-72a5-4b84-9cfc-e44aaaea6b4f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:13.596027 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ae2c4cd-72a5-4b84-9cfc-e44aaaea6b4f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:13.596479 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ae2c4cd-72a5-4b84-9cfc-e44aaaea6b4f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:13.597143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ae2c4cd-72a5-4b84-9cfc-e44aaaea6b4f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:13.597580 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ae2c4cd-72a5-4b84-9cfc-e44aaaea6b4f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:13.597983 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ae2c4cd-72a5-4b84-9cfc-e44aaaea6b4f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:13.734334 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0ae2c4cd-72a5-4b84-9cfc-e44aaaea6b4f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:13.742540 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0ae2c4cd-72a5-4b84-9cfc-e44aaaea6b4f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.157466 Oct 24 13:27:13.744542 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 152/304] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:13 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:14.491048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-5a9777c5-7aad-471d-ac54-002186554c7f req-48883400-7eec-4e71-9cf4-36b373c78e55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a9564e-c320-4bad-bcfc-8332aec8c690", "name": "network-vif-deleted", "tag": "88cc8087-11c0-4a7a-b07d-0fa49eefb5f0"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:27:14.519443 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-5a9777c5-7aad-471d-ac54-002186554c7f req-48883400-7eec-4e71-9cf4-36b373c78e55 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:14.519443 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-5a9777c5-7aad-471d-ac54-002186554c7f req-48883400-7eec-4e71-9cf4-36b373c78e55 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:14.519443 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-5a9777c5-7aad-471d-ac54-002186554c7f req-48883400-7eec-4e71-9cf4-36b373c78e55 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:14.519706 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-1c3d6021-a027-48c9-b8c7-755a54fc484f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:14.519817 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-1c3d6021-a027-48c9-b8c7-755a54fc484f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:14.528578 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1c3d6021-a027-48c9-b8c7-755a54fc484f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:14.528921 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-5a9777c5-7aad-471d-ac54-002186554c7f req-48883400-7eec-4e71-9cf4-36b373c78e55 service nova] Creating event network-vif-deleted:88cc8087-11c0-4a7a-b07d-0fa49eefb5f0 for instance 13a9564e-c320-4bad-bcfc-8332aec8c690 on hv-cinder-86249 Oct 24 13:27:14.529496 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1c3d6021-a027-48c9-b8c7-755a54fc484f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:14.530087 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1c3d6021-a027-48c9-b8c7-755a54fc484f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:14.531083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1c3d6021-a027-48c9-b8c7-755a54fc484f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:14.532039 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1c3d6021-a027-48c9-b8c7-755a54fc484f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:14.532514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1c3d6021-a027-48c9-b8c7-755a54fc484f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:14.534576 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-5a9777c5-7aad-471d-ac54-002186554c7f req-48883400-7eec-4e71-9cf4-36b373c78e55 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047539 Oct 24 13:27:14.535720 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 153/305] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:27:14.617335 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1c3d6021-a027-48c9-b8c7-755a54fc484f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:14.630225 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-1c3d6021-a027-48c9-b8c7-755a54fc484f tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1511 microversion: 2.1 time: 0.114826 Oct 24 13:27:14.631129 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 153/306] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:14 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1511 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:27:14.768059 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-add5bd5c-bc14-4394-a55f-f44d2d50c1b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:14.768864 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-add5bd5c-bc14-4394-a55f-f44d2d50c1b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:14.774892 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-add5bd5c-bc14-4394-a55f-f44d2d50c1b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:14.775358 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-add5bd5c-bc14-4394-a55f-f44d2d50c1b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:14.775853 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-add5bd5c-bc14-4394-a55f-f44d2d50c1b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:14.777085 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-add5bd5c-bc14-4394-a55f-f44d2d50c1b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:14.777527 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-add5bd5c-bc14-4394-a55f-f44d2d50c1b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:14.777941 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-add5bd5c-bc14-4394-a55f-f44d2d50c1b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:14.918105 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-add5bd5c-bc14-4394-a55f-f44d2d50c1b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:14.927177 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-add5bd5c-bc14-4394-a55f-f44d2d50c1b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.163294 Oct 24 13:27:14.927742 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 154/307] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:14 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:15.654410 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-fad8767f-4345-4980-852a-8659fe15565c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:15.655018 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-fad8767f-4345-4980-852a-8659fe15565c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:15.663460 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fad8767f-4345-4980-852a-8659fe15565c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:15.663460 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fad8767f-4345-4980-852a-8659fe15565c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:15.663912 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fad8767f-4345-4980-852a-8659fe15565c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:15.664625 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fad8767f-4345-4980-852a-8659fe15565c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:15.665088 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fad8767f-4345-4980-852a-8659fe15565c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:15.665487 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fad8767f-4345-4980-852a-8659fe15565c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:15.739395 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fad8767f-4345-4980-852a-8659fe15565c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:15.739957 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fad8767f-4345-4980-852a-8659fe15565c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:15.741923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fad8767f-4345-4980-852a-8659fe15565c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:15.742391 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.objects.instance [None req-fad8767f-4345-4980-852a-8659fe15565c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lazy-loading 'fault' on Instance uuid 13a9564e-c320-4bad-bcfc-8332aec8c690 {{(pid=119145) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:27:15.790214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-fad8767f-4345-4980-852a-8659fe15565c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495ed7e994004db99f1553ab6e0cc65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6019625869c249fbae42eff10c82c590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:15.800185 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-fad8767f-4345-4980-852a-8659fe15565c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 200 len: 1350 microversion: 2.1 time: 0.149446 Oct 24 13:27:15.800778 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 154/308] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:15 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:15.951611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c2f976d2-210f-4ae1-a102-03534f0bd138 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:15.952496 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c2f976d2-210f-4ae1-a102-03534f0bd138 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:15.959933 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c2f976d2-210f-4ae1-a102-03534f0bd138 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:15.960946 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c2f976d2-210f-4ae1-a102-03534f0bd138 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:15.961380 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c2f976d2-210f-4ae1-a102-03534f0bd138 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:15.962223 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c2f976d2-210f-4ae1-a102-03534f0bd138 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:15.962846 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c2f976d2-210f-4ae1-a102-03534f0bd138 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:15.963374 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c2f976d2-210f-4ae1-a102-03534f0bd138 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:16.121722 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c2f976d2-210f-4ae1-a102-03534f0bd138 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:16.142479 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c2f976d2-210f-4ae1-a102-03534f0bd138 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.195311 Oct 24 13:27:16.143071 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 155/309] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:15 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:16.825166 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-5f10201c-0aba-4136-a571-4125858cf96c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:16.827033 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-5f10201c-0aba-4136-a571-4125858cf96c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:16.836083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5f10201c-0aba-4136-a571-4125858cf96c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:16.836725 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5f10201c-0aba-4136-a571-4125858cf96c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:16.837220 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5f10201c-0aba-4136-a571-4125858cf96c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:16.838163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5f10201c-0aba-4136-a571-4125858cf96c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:16.838674 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5f10201c-0aba-4136-a571-4125858cf96c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:16.839195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5f10201c-0aba-4136-a571-4125858cf96c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:16.858601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-5f10201c-0aba-4136-a571-4125858cf96c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] HTTP exception thrown: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-5f10201c-0aba-4136-a571-4125858cf96c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Request method failure captured: Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 HTTP/1.1 Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpJKZtJHZnVM68wSzj3HsmbtWins1_x6Z4Xvvnxy4IWZwnCgbMftTqoRIst_oczEfwRzrj2E1JXLttsjX5K_d-m-dKtu2ShxOig_uAcreCJQl1Eg2s7Dw7DUTBDOgRSbvmdvQr9E6u4RaCflKp_Ekykp5HSruk2k9xBv-AQHTUs624k Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: 6019625869c249fbae42eff10c82c590 Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-DeleteServersTestJSON-1069291124 Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:27:16.863199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:27:16.864518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6019625869c249fbae42eff10c82c590"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6019625869c249fbae42eff10c82c590"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6019625869c249fbae42eff10c82c590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6019625869c249fbae42eff10c82c590"}]}] Oct 24 13:27:16.864518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-DeleteServersTestJSON-1069291124 Oct 24 13:27:16.864518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: 6019625869c249fbae42eff10c82c590 Oct 24 13:27:16.864518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-DeleteServersTestJSON-1069291124 Oct 24 13:27:16.864518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-DeleteServersTestJSON-1069291124-project Oct 24 13:27:16.864518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:27:16.864518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:27:16.864518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 495ed7e994004db99f1553ab6e0cc65c Oct 24 13:27:16.864518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-DeleteServersTestJSON-1069291124-project Oct 24 13:27:16.864518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:27:16.864518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. Oct 24 13:27:16.864518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': '13a9564e-c320-4bad-bcfc-8332aec8c690'} Oct 24 13:27:16.865285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:27:16.865285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:16.865285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:27:16.865285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:27:16.865285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:27:16.865285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:27:16.865285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:27:16.865285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:27:16.865285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:27:16.865285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:27:16.865285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. Oct 24 13:27:16.865285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:27:16.865285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:27:16.865285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:27:16.865285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:16.865285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:27:16.865285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:27:16.865285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:27:16.865285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:27:16.865285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:27:16.866514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:27:16.866514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:27:16.866514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:27:16.866514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:27:16.866514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:27:16.866514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:27:16.866514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:27:16.866514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. Oct 24 13:27:16.866514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:27:16.866514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:27:16.866514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:27:16.866514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:16.866514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:27:16.866514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:27:16.866514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:27:16.866514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:27:16.866514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. Oct 24 13:27:16.866514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:27:16.867568 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-5f10201c-0aba-4136-a571-4125858cf96c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Returning 404 to user: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:27:16.867568 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-5f10201c-0aba-4136-a571-4125858cf96c tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 404 len: 111 microversion: 2.1 time: 0.043946 Oct 24 13:27:16.867568 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 155/310] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:16 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:27:16.995404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5270d027-8996-46ba-b428-b48172aa4bc5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:16.997591 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5270d027-8996-46ba-b428-b48172aa4bc5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:17.003907 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5270d027-8996-46ba-b428-b48172aa4bc5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:17.004401 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5270d027-8996-46ba-b428-b48172aa4bc5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:17.004817 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5270d027-8996-46ba-b428-b48172aa4bc5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:17.005485 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5270d027-8996-46ba-b428-b48172aa4bc5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:17.005924 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5270d027-8996-46ba-b428-b48172aa4bc5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:17.006330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5270d027-8996-46ba-b428-b48172aa4bc5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:17.020289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-5270d027-8996-46ba-b428-b48172aa4bc5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] HTTP exception thrown: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5270d027-8996-46ba-b428-b48172aa4bc5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Request method failure captured: Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690/os-volume_attachments HTTP/1.1 Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpJKZtJHZnVM68wSzj3HsmbtWins1_x6Z4Xvvnxy4IWZwnCgbMftTqoRIst_oczEfwRzrj2E1JXLttsjX5K_d-m-dKtu2ShxOig_uAcreCJQl1Eg2s7Dw7DUTBDOgRSbvmdvQr9E6u4RaCflKp_Ekykp5HSruk2k9xBv-AQHTUs624k Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 6019625869c249fbae42eff10c82c590 Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-DeleteServersTestJSON-1069291124 Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:27:17.024376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:27:17.028593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6019625869c249fbae42eff10c82c590"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6019625869c249fbae42eff10c82c590"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6019625869c249fbae42eff10c82c590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6019625869c249fbae42eff10c82c590"}]}] Oct 24 13:27:17.028593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-DeleteServersTestJSON-1069291124 Oct 24 13:27:17.028593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 6019625869c249fbae42eff10c82c590 Oct 24 13:27:17.028593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-DeleteServersTestJSON-1069291124 Oct 24 13:27:17.028593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-DeleteServersTestJSON-1069291124-project Oct 24 13:27:17.028593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:27:17.028593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:27:17.028593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 495ed7e994004db99f1553ab6e0cc65c Oct 24 13:27:17.028593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-DeleteServersTestJSON-1069291124-project Oct 24 13:27:17.028593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:27:17.028593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. Oct 24 13:27:17.028593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'server_id': '13a9564e-c320-4bad-bcfc-8332aec8c690'} Oct 24 13:27:17.029427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:27:17.029427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:17.029427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:27:17.029427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:27:17.029427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:27:17.029427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:27:17.029427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:27:17.029427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:27:17.029427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:27:17.029427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:27:17.029427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. Oct 24 13:27:17.029427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:27:17.029427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:27:17.029427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:27:17.029427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:17.029427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:27:17.029427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:27:17.029427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:27:17.029427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:27:17.029427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:27:17.030826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:27:17.030826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 13:27:17.030826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:27:17.030826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 13:27:17.030826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:27:17.030826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 24 13:27:17.030826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 24 13:27:17.030826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:27:17.030826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:27:17.030826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. Oct 24 13:27:17.030826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:27:17.030826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:27:17.030826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:27:17.030826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:17.030826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:27:17.030826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:27:17.030826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:27:17.030826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:27:17.030826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. Oct 24 13:27:17.030826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:27:17.032203 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5270d027-8996-46ba-b428-b48172aa4bc5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Returning 404 to user: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:27:17.032203 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5270d027-8996-46ba-b428-b48172aa4bc5 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034349 Oct 24 13:27:17.032203 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 156/311] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 24 13:27:16 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:27:17.166144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-86cfc33e-0ece-43e6-b806-bcc6417f72d0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:17.167981 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-86cfc33e-0ece-43e6-b806-bcc6417f72d0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:17.175759 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-86cfc33e-0ece-43e6-b806-bcc6417f72d0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:17.176411 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-86cfc33e-0ece-43e6-b806-bcc6417f72d0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:17.176978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-86cfc33e-0ece-43e6-b806-bcc6417f72d0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:17.177677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-86cfc33e-0ece-43e6-b806-bcc6417f72d0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:17.178290 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-86cfc33e-0ece-43e6-b806-bcc6417f72d0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:17.178714 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-86cfc33e-0ece-43e6-b806-bcc6417f72d0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:17.200324 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:27:17.322793 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-86cfc33e-0ece-43e6-b806-bcc6417f72d0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:17.332630 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-86cfc33e-0ece-43e6-b806-bcc6417f72d0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.170508 Oct 24 13:27:17.333207 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 156/312] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:17 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:18.357636 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-586163a8-e988-460f-bdac-447bba4a99aa tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:18.358544 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-586163a8-e988-460f-bdac-447bba4a99aa tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:18.361344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=41 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:27:18.367017 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-586163a8-e988-460f-bdac-447bba4a99aa tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:18.367507 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-586163a8-e988-460f-bdac-447bba4a99aa tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:18.367940 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-586163a8-e988-460f-bdac-447bba4a99aa tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:18.368668 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-586163a8-e988-460f-bdac-447bba4a99aa tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:18.369115 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-586163a8-e988-460f-bdac-447bba4a99aa tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:18.369533 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-586163a8-e988-460f-bdac-447bba4a99aa tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:18.412305 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9ef43c49-3a20-4c2b-9498-bc2cd3de490b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:18.413293 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9ef43c49-3a20-4c2b-9498-bc2cd3de490b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:18.428017 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ef43c49-3a20-4c2b-9498-bc2cd3de490b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:18.428915 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ef43c49-3a20-4c2b-9498-bc2cd3de490b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:18.429500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ef43c49-3a20-4c2b-9498-bc2cd3de490b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:18.430375 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ef43c49-3a20-4c2b-9498-bc2cd3de490b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:18.434296 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ef43c49-3a20-4c2b-9498-bc2cd3de490b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:18.434296 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ef43c49-3a20-4c2b-9498-bc2cd3de490b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:18.453002 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-9ef43c49-3a20-4c2b-9498-bc2cd3de490b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] HTTP exception thrown: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9ef43c49-3a20-4c2b-9498-bc2cd3de490b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Request method failure captured: Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: DELETE /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 HTTP/1.1 Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpJKZtJHZnVM68wSzj3HsmbtWins1_x6Z4Xvvnxy4IWZwnCgbMftTqoRIst_oczEfwRzrj2E1JXLttsjX5K_d-m-dKtu2ShxOig_uAcreCJQl1Eg2s7Dw7DUTBDOgRSbvmdvQr9E6u4RaCflKp_Ekykp5HSruk2k9xBv-AQHTUs624k Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: 6019625869c249fbae42eff10c82c590 Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-DeleteServersTestJSON-1069291124 Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:27:18.454805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:27:18.456144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6019625869c249fbae42eff10c82c590"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6019625869c249fbae42eff10c82c590"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6019625869c249fbae42eff10c82c590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6019625869c249fbae42eff10c82c590"}]}] Oct 24 13:27:18.456144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-DeleteServersTestJSON-1069291124 Oct 24 13:27:18.456144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: 6019625869c249fbae42eff10c82c590 Oct 24 13:27:18.456144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-DeleteServersTestJSON-1069291124 Oct 24 13:27:18.456144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-DeleteServersTestJSON-1069291124-project Oct 24 13:27:18.456144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:27:18.456144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:27:18.456144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 495ed7e994004db99f1553ab6e0cc65c Oct 24 13:27:18.456144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-DeleteServersTestJSON-1069291124-project Oct 24 13:27:18.456144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:27:18.456144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. Oct 24 13:27:18.456144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': '13a9564e-c320-4bad-bcfc-8332aec8c690'} Oct 24 13:27:18.463229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:27:18.463229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:18.463229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:27:18.463229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:27:18.463229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:27:18.463229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:27:18.463229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:27:18.463229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:27:18.463229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:27:18.463229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:27:18.463229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. Oct 24 13:27:18.463229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:27:18.463229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:27:18.463229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:27:18.463229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:18.463229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:27:18.463229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:27:18.463229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:27:18.463229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:27:18.463229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:27:18.465955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:27:18.465955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:27:18.465955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:27:18.465955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:27:18.465955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:27:18.465955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:27:18.465955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:27:18.465955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:27:18.465955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:27:18.465955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. Oct 24 13:27:18.465955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:27:18.465955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:27:18.465955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:27:18.465955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:18.465955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:27:18.465955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:27:18.465955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:27:18.465955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:27:18.465955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. Oct 24 13:27:18.465955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:27:18.467491 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9ef43c49-3a20-4c2b-9498-bc2cd3de490b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Returning 404 to user: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:27:18.467491 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9ef43c49-3a20-4c2b-9498-bc2cd3de490b tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "DELETE /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 404 len: 111 microversion: 2.1 time: 0.048868 Oct 24 13:27:18.467491 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 157/313] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:27:18 2022] DELETE /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:27:18.473801 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-71a34a00-8fd0-4ada-bcf7-1b1cf5cbcbd1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:18.474542 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-71a34a00-8fd0-4ada-bcf7-1b1cf5cbcbd1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] [instance: 13a9564e-c320-4bad-bcfc-8332aec8c690] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:18.482280 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-71a34a00-8fd0-4ada-bcf7-1b1cf5cbcbd1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:18.482829 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-71a34a00-8fd0-4ada-bcf7-1b1cf5cbcbd1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:18.483310 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-71a34a00-8fd0-4ada-bcf7-1b1cf5cbcbd1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:18.484001 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-71a34a00-8fd0-4ada-bcf7-1b1cf5cbcbd1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:18.484471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-71a34a00-8fd0-4ada-bcf7-1b1cf5cbcbd1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:18.489208 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-71a34a00-8fd0-4ada-bcf7-1b1cf5cbcbd1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:18.500090 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-71a34a00-8fd0-4ada-bcf7-1b1cf5cbcbd1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] HTTP exception thrown: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-71a34a00-8fd0-4ada-bcf7-1b1cf5cbcbd1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Request method failure captured: Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 HTTP/1.1 Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpJKZtJHZnVM68wSzj3HsmbtWins1_x6Z4Xvvnxy4IWZwnCgbMftTqoRIst_oczEfwRzrj2E1JXLttsjX5K_d-m-dKtu2ShxOig_uAcreCJQl1Eg2s7Dw7DUTBDOgRSbvmdvQr9E6u4RaCflKp_Ekykp5HSruk2k9xBv-AQHTUs624k Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: 6019625869c249fbae42eff10c82c590 Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-DeleteServersTestJSON-1069291124 Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:27:18.501645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:27:18.503245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6019625869c249fbae42eff10c82c590"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6019625869c249fbae42eff10c82c590"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6019625869c249fbae42eff10c82c590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6019625869c249fbae42eff10c82c590"}]}] Oct 24 13:27:18.503245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-DeleteServersTestJSON-1069291124 Oct 24 13:27:18.503245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: 6019625869c249fbae42eff10c82c590 Oct 24 13:27:18.503245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-DeleteServersTestJSON-1069291124 Oct 24 13:27:18.503245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-DeleteServersTestJSON-1069291124-project Oct 24 13:27:18.503245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:27:18.503245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:27:18.503245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 495ed7e994004db99f1553ab6e0cc65c Oct 24 13:27:18.503245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-DeleteServersTestJSON-1069291124-project Oct 24 13:27:18.503245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:27:18.503245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. Oct 24 13:27:18.503245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': '13a9564e-c320-4bad-bcfc-8332aec8c690'} Oct 24 13:27:18.504214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:27:18.504214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:18.504214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:27:18.504214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:27:18.504214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:27:18.504214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:27:18.504214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:27:18.504214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:27:18.504214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:27:18.504214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:27:18.504214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. Oct 24 13:27:18.504214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:27:18.504214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:27:18.504214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:27:18.504214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:18.504214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:27:18.504214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:27:18.504214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:27:18.504214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:27:18.504214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:27:18.505729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:27:18.505729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:27:18.505729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:27:18.505729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:27:18.505729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:27:18.505729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:27:18.505729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:27:18.505729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. Oct 24 13:27:18.505729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:27:18.505729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:27:18.505729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:27:18.505729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:18.505729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:27:18.505729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:27:18.505729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:27:18.505729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:27:18.505729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. Oct 24 13:27:18.505729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:27:18.506725 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-71a34a00-8fd0-4ada-bcf7-1b1cf5cbcbd1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] Returning 404 to user: Instance 13a9564e-c320-4bad-bcfc-8332aec8c690 could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:27:18.506725 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-71a34a00-8fd0-4ada-bcf7-1b1cf5cbcbd1 tempest-DeleteServersTestJSON-1069291124 tempest-DeleteServersTestJSON-1069291124-project] 10.222.0.48 "GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690" status: 404 len: 111 microversion: 2.1 time: 0.033649 Oct 24 13:27:18.506725 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 158/314] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:18 2022] GET /compute/v2.1/servers/13a9564e-c320-4bad-bcfc-8332aec8c690 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:27:18.523318 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-586163a8-e988-460f-bdac-447bba4a99aa tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:18.532718 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-586163a8-e988-460f-bdac-447bba4a99aa tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.179914 Oct 24 13:27:18.533775 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 157/315] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:18 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:19.558257 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c3358556-30c8-4108-845c-78e573b218dd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:19.558966 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-c3358556-30c8-4108-845c-78e573b218dd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:19.573823 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c3358556-30c8-4108-845c-78e573b218dd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:19.573823 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c3358556-30c8-4108-845c-78e573b218dd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:19.573823 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c3358556-30c8-4108-845c-78e573b218dd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:19.573823 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c3358556-30c8-4108-845c-78e573b218dd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:19.574209 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c3358556-30c8-4108-845c-78e573b218dd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:19.574209 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c3358556-30c8-4108-845c-78e573b218dd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:19.783832 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c3358556-30c8-4108-845c-78e573b218dd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:19.791485 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-c3358556-30c8-4108-845c-78e573b218dd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.237844 Oct 24 13:27:19.792677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 159/316] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:19 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:27:20.819330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c94a7781-85ce-43fc-abd0-518e7bb30fe8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:20.819975 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c94a7781-85ce-43fc-abd0-518e7bb30fe8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:20.826956 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c94a7781-85ce-43fc-abd0-518e7bb30fe8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:20.827828 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c94a7781-85ce-43fc-abd0-518e7bb30fe8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:20.828441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c94a7781-85ce-43fc-abd0-518e7bb30fe8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:20.830237 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c94a7781-85ce-43fc-abd0-518e7bb30fe8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:20.831337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c94a7781-85ce-43fc-abd0-518e7bb30fe8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:20.831768 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c94a7781-85ce-43fc-abd0-518e7bb30fe8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:21.049486 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c94a7781-85ce-43fc-abd0-518e7bb30fe8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:21.060751 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c94a7781-85ce-43fc-abd0-518e7bb30fe8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.246708 Oct 24 13:27:21.061988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 158/317] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:20 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:22.084938 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ac18ae69-ef77-4880-aaff-90786bcf0374 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:22.085657 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ac18ae69-ef77-4880-aaff-90786bcf0374 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:22.087698 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:27:22.092525 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ac18ae69-ef77-4880-aaff-90786bcf0374 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:22.093002 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ac18ae69-ef77-4880-aaff-90786bcf0374 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:22.093430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ac18ae69-ef77-4880-aaff-90786bcf0374 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:22.094125 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ac18ae69-ef77-4880-aaff-90786bcf0374 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:22.094568 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ac18ae69-ef77-4880-aaff-90786bcf0374 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:22.094981 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ac18ae69-ef77-4880-aaff-90786bcf0374 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:22.312201 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ac18ae69-ef77-4880-aaff-90786bcf0374 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:22.320486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ac18ae69-ef77-4880-aaff-90786bcf0374 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.239257 Oct 24 13:27:22.321287 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 160/318] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:22 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:23.344206 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-2a07a730-39e2-4635-b158-9e99688c1a0f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:23.344907 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-2a07a730-39e2-4635-b158-9e99688c1a0f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:23.350921 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2a07a730-39e2-4635-b158-9e99688c1a0f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:23.351394 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2a07a730-39e2-4635-b158-9e99688c1a0f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:23.351824 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2a07a730-39e2-4635-b158-9e99688c1a0f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:23.352560 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2a07a730-39e2-4635-b158-9e99688c1a0f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:23.353010 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2a07a730-39e2-4635-b158-9e99688c1a0f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:23.353447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2a07a730-39e2-4635-b158-9e99688c1a0f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:23.357914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:27:23.486353 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-2a07a730-39e2-4635-b158-9e99688c1a0f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:23.494533 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-2a07a730-39e2-4635-b158-9e99688c1a0f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.154423 Oct 24 13:27:23.495133 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 159/319] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:23 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:24.521294 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0ec3e815-5168-489d-bc3d-1bfd891c2453 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:24.521871 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0ec3e815-5168-489d-bc3d-1bfd891c2453 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:24.529418 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ec3e815-5168-489d-bc3d-1bfd891c2453 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:24.529894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ec3e815-5168-489d-bc3d-1bfd891c2453 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:24.530347 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ec3e815-5168-489d-bc3d-1bfd891c2453 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:24.530976 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ec3e815-5168-489d-bc3d-1bfd891c2453 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:24.531415 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ec3e815-5168-489d-bc3d-1bfd891c2453 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:24.531821 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ec3e815-5168-489d-bc3d-1bfd891c2453 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:24.670470 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0ec3e815-5168-489d-bc3d-1bfd891c2453 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:24.678167 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0ec3e815-5168-489d-bc3d-1bfd891c2453 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.163805 Oct 24 13:27:24.678857 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 161/320] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:24 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:25.701641 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7d17e8c2-736a-4a80-bdd4-fba07e827376 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:25.702343 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7d17e8c2-736a-4a80-bdd4-fba07e827376 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:25.709662 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7d17e8c2-736a-4a80-bdd4-fba07e827376 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:25.710209 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7d17e8c2-736a-4a80-bdd4-fba07e827376 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:25.710648 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7d17e8c2-736a-4a80-bdd4-fba07e827376 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:25.711342 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7d17e8c2-736a-4a80-bdd4-fba07e827376 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:25.713344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7d17e8c2-736a-4a80-bdd4-fba07e827376 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:25.714103 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7d17e8c2-736a-4a80-bdd4-fba07e827376 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:25.854207 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7d17e8c2-736a-4a80-bdd4-fba07e827376 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:25.862523 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7d17e8c2-736a-4a80-bdd4-fba07e827376 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.164911 Oct 24 13:27:25.863167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 160/321] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:25 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:26.886460 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-18ca962f-5ad0-402a-84d6-c71ed8f17d13 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:26.886991 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-18ca962f-5ad0-402a-84d6-c71ed8f17d13 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:26.893114 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-18ca962f-5ad0-402a-84d6-c71ed8f17d13 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:26.898627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-18ca962f-5ad0-402a-84d6-c71ed8f17d13 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:26.898627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-18ca962f-5ad0-402a-84d6-c71ed8f17d13 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:26.898627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-18ca962f-5ad0-402a-84d6-c71ed8f17d13 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:26.898627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-18ca962f-5ad0-402a-84d6-c71ed8f17d13 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:26.898957 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-18ca962f-5ad0-402a-84d6-c71ed8f17d13 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:27.025240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-18ca962f-5ad0-402a-84d6-c71ed8f17d13 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:27.033438 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-18ca962f-5ad0-402a-84d6-c71ed8f17d13 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.151085 Oct 24 13:27:27.034263 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 162/322] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:26 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:28.057078 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a90967ec-d7ca-45c8-87ed-4019dac040e1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:28.057680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a90967ec-d7ca-45c8-87ed-4019dac040e1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:28.063993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a90967ec-d7ca-45c8-87ed-4019dac040e1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:28.064498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a90967ec-d7ca-45c8-87ed-4019dac040e1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:28.064925 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a90967ec-d7ca-45c8-87ed-4019dac040e1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:28.065596 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a90967ec-d7ca-45c8-87ed-4019dac040e1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:28.066035 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a90967ec-d7ca-45c8-87ed-4019dac040e1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:28.066760 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a90967ec-d7ca-45c8-87ed-4019dac040e1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:28.291075 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a90967ec-d7ca-45c8-87ed-4019dac040e1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:28.298789 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a90967ec-d7ca-45c8-87ed-4019dac040e1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.245658 Oct 24 13:27:28.312292 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 161/323] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:28 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:29.322723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-34e13822-6460-4b9a-907d-49d95a3c0feb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:29.323318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-34e13822-6460-4b9a-907d-49d95a3c0feb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:29.330972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34e13822-6460-4b9a-907d-49d95a3c0feb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:29.331436 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34e13822-6460-4b9a-907d-49d95a3c0feb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:29.331863 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34e13822-6460-4b9a-907d-49d95a3c0feb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:29.332640 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34e13822-6460-4b9a-907d-49d95a3c0feb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:29.333085 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34e13822-6460-4b9a-907d-49d95a3c0feb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:29.333496 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34e13822-6460-4b9a-907d-49d95a3c0feb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:29.628788 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-34e13822-6460-4b9a-907d-49d95a3c0feb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:29.638039 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-34e13822-6460-4b9a-907d-49d95a3c0feb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.319003 Oct 24 13:27:29.638935 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 163/324] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:29 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:30.662049 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-d8258324-a7a1-4ef2-b4e2-8c16f46007ee tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:30.662655 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-d8258324-a7a1-4ef2-b4e2-8c16f46007ee tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:30.668981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d8258324-a7a1-4ef2-b4e2-8c16f46007ee tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:30.669459 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d8258324-a7a1-4ef2-b4e2-8c16f46007ee tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:30.669885 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d8258324-a7a1-4ef2-b4e2-8c16f46007ee tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:30.670571 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d8258324-a7a1-4ef2-b4e2-8c16f46007ee tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:30.671017 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d8258324-a7a1-4ef2-b4e2-8c16f46007ee tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:30.671433 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d8258324-a7a1-4ef2-b4e2-8c16f46007ee tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:30.815811 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-d8258324-a7a1-4ef2-b4e2-8c16f46007ee tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:30.826351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-d8258324-a7a1-4ef2-b4e2-8c16f46007ee tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.168107 Oct 24 13:27:30.826949 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 162/325] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:30 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:31.849944 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-bef6c51b-af41-4c0d-9ac4-c8ed6a849357 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:31.850542 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-bef6c51b-af41-4c0d-9ac4-c8ed6a849357 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:31.857050 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bef6c51b-af41-4c0d-9ac4-c8ed6a849357 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:31.857522 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bef6c51b-af41-4c0d-9ac4-c8ed6a849357 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:31.857948 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bef6c51b-af41-4c0d-9ac4-c8ed6a849357 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:31.858621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bef6c51b-af41-4c0d-9ac4-c8ed6a849357 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:31.859061 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bef6c51b-af41-4c0d-9ac4-c8ed6a849357 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:31.859473 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bef6c51b-af41-4c0d-9ac4-c8ed6a849357 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:32.000585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-bef6c51b-af41-4c0d-9ac4-c8ed6a849357 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:32.010340 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-bef6c51b-af41-4c0d-9ac4-c8ed6a849357 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.164098 Oct 24 13:27:32.011559 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 164/326] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:31 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:33.034148 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-77e3de6c-853c-4a70-b14b-6d6b69d970df tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:33.035030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-77e3de6c-853c-4a70-b14b-6d6b69d970df tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:33.041520 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-77e3de6c-853c-4a70-b14b-6d6b69d970df tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:33.042000 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-77e3de6c-853c-4a70-b14b-6d6b69d970df tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:33.042616 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-77e3de6c-853c-4a70-b14b-6d6b69d970df tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:33.043862 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-77e3de6c-853c-4a70-b14b-6d6b69d970df tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:33.044370 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-77e3de6c-853c-4a70-b14b-6d6b69d970df tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:33.044790 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-77e3de6c-853c-4a70-b14b-6d6b69d970df tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:33.211925 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-77e3de6c-853c-4a70-b14b-6d6b69d970df tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:33.220801 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-77e3de6c-853c-4a70-b14b-6d6b69d970df tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.190758 Oct 24 13:27:33.221339 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 163/327] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:33 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:34.246448 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f598e027-1d2c-4364-823d-d2285a117062 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:34.247849 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f598e027-1d2c-4364-823d-d2285a117062 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:34.260438 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f598e027-1d2c-4364-823d-d2285a117062 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:34.260854 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f598e027-1d2c-4364-823d-d2285a117062 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:34.261274 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f598e027-1d2c-4364-823d-d2285a117062 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:34.262528 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f598e027-1d2c-4364-823d-d2285a117062 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:34.262972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f598e027-1d2c-4364-823d-d2285a117062 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:34.263382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f598e027-1d2c-4364-823d-d2285a117062 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:34.420135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f598e027-1d2c-4364-823d-d2285a117062 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:34.428143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f598e027-1d2c-4364-823d-d2285a117062 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.186384 Oct 24 13:27:34.428759 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 165/328] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:34 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:35.452739 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-d8095e4c-c0a9-4cd2-a7aa-2efdf421fd58 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:35.457318 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-d8095e4c-c0a9-4cd2-a7aa-2efdf421fd58 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:35.466294 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d8095e4c-c0a9-4cd2-a7aa-2efdf421fd58 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:35.466982 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d8095e4c-c0a9-4cd2-a7aa-2efdf421fd58 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:35.467576 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d8095e4c-c0a9-4cd2-a7aa-2efdf421fd58 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:35.468723 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d8095e4c-c0a9-4cd2-a7aa-2efdf421fd58 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:35.469717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d8095e4c-c0a9-4cd2-a7aa-2efdf421fd58 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:35.470147 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d8095e4c-c0a9-4cd2-a7aa-2efdf421fd58 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:35.664441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-d8095e4c-c0a9-4cd2-a7aa-2efdf421fd58 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:35.674490 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-d8095e4c-c0a9-4cd2-a7aa-2efdf421fd58 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.226550 Oct 24 13:27:35.675449 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 164/329] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:35 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:36.697731 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-601d9f83-4627-43aa-8e94-14e1b1002446 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:36.698324 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-601d9f83-4627-43aa-8e94-14e1b1002446 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:36.705207 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-601d9f83-4627-43aa-8e94-14e1b1002446 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:36.705670 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-601d9f83-4627-43aa-8e94-14e1b1002446 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:36.706086 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-601d9f83-4627-43aa-8e94-14e1b1002446 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:36.706757 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-601d9f83-4627-43aa-8e94-14e1b1002446 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:36.707200 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-601d9f83-4627-43aa-8e94-14e1b1002446 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:36.707611 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-601d9f83-4627-43aa-8e94-14e1b1002446 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:36.851186 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-601d9f83-4627-43aa-8e94-14e1b1002446 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:36.858811 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-601d9f83-4627-43aa-8e94-14e1b1002446 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.164954 Oct 24 13:27:36.859688 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 166/330] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:36 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:37.881053 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-520732a4-c059-4bcb-a55d-e3bb50da6c5c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:37.881655 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-520732a4-c059-4bcb-a55d-e3bb50da6c5c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:37.887944 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-520732a4-c059-4bcb-a55d-e3bb50da6c5c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:37.888414 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-520732a4-c059-4bcb-a55d-e3bb50da6c5c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:37.888843 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-520732a4-c059-4bcb-a55d-e3bb50da6c5c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:37.889524 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-520732a4-c059-4bcb-a55d-e3bb50da6c5c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:37.889966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-520732a4-c059-4bcb-a55d-e3bb50da6c5c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:37.890382 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-520732a4-c059-4bcb-a55d-e3bb50da6c5c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:38.025226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-520732a4-c059-4bcb-a55d-e3bb50da6c5c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:38.033377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-520732a4-c059-4bcb-a55d-e3bb50da6c5c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.156157 Oct 24 13:27:38.034108 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 165/331] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:37 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:39.056455 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b6f2a66c-7a2c-4f35-8feb-18100daf4344 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:39.059466 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b6f2a66c-7a2c-4f35-8feb-18100daf4344 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:39.063657 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6f2a66c-7a2c-4f35-8feb-18100daf4344 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:39.064132 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6f2a66c-7a2c-4f35-8feb-18100daf4344 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:39.064590 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6f2a66c-7a2c-4f35-8feb-18100daf4344 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:39.065272 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6f2a66c-7a2c-4f35-8feb-18100daf4344 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:39.065721 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6f2a66c-7a2c-4f35-8feb-18100daf4344 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:39.066240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6f2a66c-7a2c-4f35-8feb-18100daf4344 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:39.193337 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b6f2a66c-7a2c-4f35-8feb-18100daf4344 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:39.201092 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b6f2a66c-7a2c-4f35-8feb-18100daf4344 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.148548 Oct 24 13:27:39.201660 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 167/332] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:39 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:40.223631 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-74abda8f-4cff-4742-8c6b-f66a7ac450d4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:40.224232 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-74abda8f-4cff-4742-8c6b-f66a7ac450d4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:40.230539 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-74abda8f-4cff-4742-8c6b-f66a7ac450d4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:40.231006 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-74abda8f-4cff-4742-8c6b-f66a7ac450d4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:40.231425 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-74abda8f-4cff-4742-8c6b-f66a7ac450d4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:40.232092 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-74abda8f-4cff-4742-8c6b-f66a7ac450d4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:40.232563 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-74abda8f-4cff-4742-8c6b-f66a7ac450d4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:40.232972 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-74abda8f-4cff-4742-8c6b-f66a7ac450d4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:40.360928 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-74abda8f-4cff-4742-8c6b-f66a7ac450d4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:40.368542 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-74abda8f-4cff-4742-8c6b-f66a7ac450d4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.148620 Oct 24 13:27:40.369101 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 166/333] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:40 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:41.392770 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-5eb32566-b318-4036-9614-f662fdc74a6b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:41.393375 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-5eb32566-b318-4036-9614-f662fdc74a6b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:41.399200 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5eb32566-b318-4036-9614-f662fdc74a6b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:41.399673 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5eb32566-b318-4036-9614-f662fdc74a6b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:41.400098 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5eb32566-b318-4036-9614-f662fdc74a6b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:41.400807 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5eb32566-b318-4036-9614-f662fdc74a6b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:41.401249 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5eb32566-b318-4036-9614-f662fdc74a6b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:41.401664 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5eb32566-b318-4036-9614-f662fdc74a6b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:41.534630 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-5eb32566-b318-4036-9614-f662fdc74a6b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:41.542324 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-5eb32566-b318-4036-9614-f662fdc74a6b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.153289 Oct 24 13:27:41.542891 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 168/334] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:41 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:42.565563 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-de736cd7-1a34-421b-bbf1-4220c8eafbce tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:42.566170 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-de736cd7-1a34-421b-bbf1-4220c8eafbce tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:42.572546 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-de736cd7-1a34-421b-bbf1-4220c8eafbce tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:42.573018 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-de736cd7-1a34-421b-bbf1-4220c8eafbce tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:42.573445 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-de736cd7-1a34-421b-bbf1-4220c8eafbce tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:42.574123 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-de736cd7-1a34-421b-bbf1-4220c8eafbce tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:42.574570 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-de736cd7-1a34-421b-bbf1-4220c8eafbce tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:42.574983 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-de736cd7-1a34-421b-bbf1-4220c8eafbce tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:42.701937 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-de736cd7-1a34-421b-bbf1-4220c8eafbce tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:42.709810 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-de736cd7-1a34-421b-bbf1-4220c8eafbce tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.148008 Oct 24 13:27:42.710363 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 167/335] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:42 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:43.732091 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-860d5556-92fc-4b93-bed1-f15171316aa5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:43.732719 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-860d5556-92fc-4b93-bed1-f15171316aa5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:43.738572 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-860d5556-92fc-4b93-bed1-f15171316aa5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:43.739038 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-860d5556-92fc-4b93-bed1-f15171316aa5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:43.739458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-860d5556-92fc-4b93-bed1-f15171316aa5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:43.740128 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-860d5556-92fc-4b93-bed1-f15171316aa5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:43.740592 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-860d5556-92fc-4b93-bed1-f15171316aa5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:43.741000 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-860d5556-92fc-4b93-bed1-f15171316aa5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:43.871782 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-860d5556-92fc-4b93-bed1-f15171316aa5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:43.880116 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-860d5556-92fc-4b93-bed1-f15171316aa5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.151864 Oct 24 13:27:43.880707 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 169/336] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:43 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:44.902777 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-71855296-66f2-45cb-9d72-792e364bec5c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:44.903915 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-71855296-66f2-45cb-9d72-792e364bec5c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:44.910348 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-71855296-66f2-45cb-9d72-792e364bec5c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:44.910825 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-71855296-66f2-45cb-9d72-792e364bec5c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:44.911253 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-71855296-66f2-45cb-9d72-792e364bec5c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:44.911939 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-71855296-66f2-45cb-9d72-792e364bec5c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:44.912411 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-71855296-66f2-45cb-9d72-792e364bec5c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:44.912832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-71855296-66f2-45cb-9d72-792e364bec5c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:45.036942 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-71855296-66f2-45cb-9d72-792e364bec5c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:45.044704 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-71855296-66f2-45cb-9d72-792e364bec5c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.145715 Oct 24 13:27:45.045276 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 168/337] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:44 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:46.067542 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6f8dd7a4-58dd-43f5-89b9-a444f442fcba tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:46.068146 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-6f8dd7a4-58dd-43f5-89b9-a444f442fcba tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:46.078900 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6f8dd7a4-58dd-43f5-89b9-a444f442fcba tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:46.078900 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6f8dd7a4-58dd-43f5-89b9-a444f442fcba tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:46.078900 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6f8dd7a4-58dd-43f5-89b9-a444f442fcba tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:46.078900 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6f8dd7a4-58dd-43f5-89b9-a444f442fcba tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:46.079404 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6f8dd7a4-58dd-43f5-89b9-a444f442fcba tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:46.079404 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6f8dd7a4-58dd-43f5-89b9-a444f442fcba tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:46.203225 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-6f8dd7a4-58dd-43f5-89b9-a444f442fcba tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:46.211052 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6f8dd7a4-58dd-43f5-89b9-a444f442fcba tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.147260 Oct 24 13:27:46.211602 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 170/338] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:46 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:47.233792 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-2e1c82a4-fd79-4a0f-a577-a91c979bf2a2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:47.234299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-2e1c82a4-fd79-4a0f-a577-a91c979bf2a2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:47.240738 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2e1c82a4-fd79-4a0f-a577-a91c979bf2a2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:47.241213 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2e1c82a4-fd79-4a0f-a577-a91c979bf2a2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:47.241642 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2e1c82a4-fd79-4a0f-a577-a91c979bf2a2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:47.242496 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2e1c82a4-fd79-4a0f-a577-a91c979bf2a2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:47.242944 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2e1c82a4-fd79-4a0f-a577-a91c979bf2a2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:47.243362 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2e1c82a4-fd79-4a0f-a577-a91c979bf2a2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:47.374886 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-2e1c82a4-fd79-4a0f-a577-a91c979bf2a2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:47.382564 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-2e1c82a4-fd79-4a0f-a577-a91c979bf2a2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.153362 Oct 24 13:27:47.383133 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 169/339] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:47 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:48.405841 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-bac7448c-51a8-41c9-9b85-afcf37c44388 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:48.406447 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-bac7448c-51a8-41c9-9b85-afcf37c44388 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:48.412707 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bac7448c-51a8-41c9-9b85-afcf37c44388 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:48.413185 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bac7448c-51a8-41c9-9b85-afcf37c44388 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:48.413610 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bac7448c-51a8-41c9-9b85-afcf37c44388 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:48.414281 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bac7448c-51a8-41c9-9b85-afcf37c44388 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:48.414724 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bac7448c-51a8-41c9-9b85-afcf37c44388 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:48.415138 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bac7448c-51a8-41c9-9b85-afcf37c44388 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:48.543675 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-bac7448c-51a8-41c9-9b85-afcf37c44388 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:48.551563 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-bac7448c-51a8-41c9-9b85-afcf37c44388 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1521 microversion: 2.1 time: 0.150141 Oct 24 13:27:48.552186 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 171/340] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:48 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:49.574865 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-27bd6975-6e06-484d-8fb4-407c079c650b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:49.575464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-27bd6975-6e06-484d-8fb4-407c079c650b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:49.577754 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=26 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:27:49.582760 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-27bd6975-6e06-484d-8fb4-407c079c650b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:49.583223 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-27bd6975-6e06-484d-8fb4-407c079c650b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:49.583653 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-27bd6975-6e06-484d-8fb4-407c079c650b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:49.584357 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-27bd6975-6e06-484d-8fb4-407c079c650b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:49.584807 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-27bd6975-6e06-484d-8fb4-407c079c650b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:49.585227 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-27bd6975-6e06-484d-8fb4-407c079c650b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:49.721707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-27bd6975-6e06-484d-8fb4-407c079c650b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:49.733535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-27bd6975-6e06-484d-8fb4-407c079c650b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1501 microversion: 2.1 time: 0.162147 Oct 24 13:27:49.734365 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 170/341] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:49 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:49.759695 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-4080cf08-5a2a-4612-91aa-6540499909ae tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:49.760422 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-4080cf08-5a2a-4612-91aa-6540499909ae tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:49.767049 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4080cf08-5a2a-4612-91aa-6540499909ae tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:49.767524 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4080cf08-5a2a-4612-91aa-6540499909ae tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:49.768081 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4080cf08-5a2a-4612-91aa-6540499909ae tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:49.768783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4080cf08-5a2a-4612-91aa-6540499909ae tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:49.769307 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4080cf08-5a2a-4612-91aa-6540499909ae tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:49.769774 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4080cf08-5a2a-4612-91aa-6540499909ae tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:49.774397 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=85 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:27:49.902101 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-4080cf08-5a2a-4612-91aa-6540499909ae tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:49.910271 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-4080cf08-5a2a-4612-91aa-6540499909ae tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1514 microversion: 2.1 time: 0.154448 Oct 24 13:27:49.910831 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 172/342] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:49 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:52.784518 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bb5074ba-b10e-40c0-85d2-fc9547da12e9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:27:52.786711 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bb5074ba-b10e-40c0-85d2-fc9547da12e9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:52.793208 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb5074ba-b10e-40c0-85d2-fc9547da12e9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:52.794842 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb5074ba-b10e-40c0-85d2-fc9547da12e9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:52.794842 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb5074ba-b10e-40c0-85d2-fc9547da12e9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:52.794842 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb5074ba-b10e-40c0-85d2-fc9547da12e9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:52.795174 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb5074ba-b10e-40c0-85d2-fc9547da12e9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:52.795611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb5074ba-b10e-40c0-85d2-fc9547da12e9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:52.818562 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.objects.instance [None req-bb5074ba-b10e-40c0-85d2-fc9547da12e9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lazy-loading 'flavor' on Instance uuid 48b2c12f-1e60-4000-ac5c-d7a5864939a1 {{(pid=119146) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:27:53.097372 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-bb5074ba-b10e-40c0-85d2-fc9547da12e9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "POST /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1/action" status: 200 len: 32 microversion: 2.1 time: 0.316859 Oct 24 13:27:53.098074 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 171/343] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 24 13:27:52 2022] POST /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1/action => generated 32 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:27:53.108508 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e8d0bb4b-9476-40d3-ad49-331fb6d669b7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:53.109537 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e8d0bb4b-9476-40d3-ad49-331fb6d669b7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:53.111413 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=26 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:27:53.117373 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e8d0bb4b-9476-40d3-ad49-331fb6d669b7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:53.117812 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e8d0bb4b-9476-40d3-ad49-331fb6d669b7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:53.118349 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e8d0bb4b-9476-40d3-ad49-331fb6d669b7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:53.119192 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e8d0bb4b-9476-40d3-ad49-331fb6d669b7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:53.119636 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e8d0bb4b-9476-40d3-ad49-331fb6d669b7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:53.120056 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e8d0bb4b-9476-40d3-ad49-331fb6d669b7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:53.253745 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e8d0bb4b-9476-40d3-ad49-331fb6d669b7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:53.261854 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e8d0bb4b-9476-40d3-ad49-331fb6d669b7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1520 microversion: 2.1 time: 0.157420 Oct 24 13:27:53.262471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 173/344] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:53 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:54.287034 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c6c652ba-3cce-4a53-b4cb-8f2a74925e16 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:54.287751 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c6c652ba-3cce-4a53-b4cb-8f2a74925e16 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:54.294651 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c6c652ba-3cce-4a53-b4cb-8f2a74925e16 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:54.295126 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c6c652ba-3cce-4a53-b4cb-8f2a74925e16 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:54.295577 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c6c652ba-3cce-4a53-b4cb-8f2a74925e16 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:54.296252 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c6c652ba-3cce-4a53-b4cb-8f2a74925e16 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:54.296722 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c6c652ba-3cce-4a53-b4cb-8f2a74925e16 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:54.297133 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c6c652ba-3cce-4a53-b4cb-8f2a74925e16 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:54.482885 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c6c652ba-3cce-4a53-b4cb-8f2a74925e16 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:54.492813 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c6c652ba-3cce-4a53-b4cb-8f2a74925e16 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1520 microversion: 2.1 time: 0.210018 Oct 24 13:27:54.493403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 172/345] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:54 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:55.520765 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ecdddcac-517f-4696-baed-e79b48d0aac3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:55.521375 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ecdddcac-517f-4696-baed-e79b48d0aac3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:55.527747 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ecdddcac-517f-4696-baed-e79b48d0aac3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:55.528234 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ecdddcac-517f-4696-baed-e79b48d0aac3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:55.528692 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ecdddcac-517f-4696-baed-e79b48d0aac3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:55.529581 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ecdddcac-517f-4696-baed-e79b48d0aac3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:55.530215 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ecdddcac-517f-4696-baed-e79b48d0aac3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:55.530654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ecdddcac-517f-4696-baed-e79b48d0aac3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:55.672832 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ecdddcac-517f-4696-baed-e79b48d0aac3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:55.681328 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ecdddcac-517f-4696-baed-e79b48d0aac3 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1520 microversion: 2.1 time: 0.164358 Oct 24 13:27:55.681940 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 174/346] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:55 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:56.711647 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-69d606d2-1a5b-44c5-874b-952cb3a6d9ae tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:56.713000 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-69d606d2-1a5b-44c5-874b-952cb3a6d9ae tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:56.738731 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-69d606d2-1a5b-44c5-874b-952cb3a6d9ae tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:56.739256 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-69d606d2-1a5b-44c5-874b-952cb3a6d9ae tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:56.739726 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-69d606d2-1a5b-44c5-874b-952cb3a6d9ae tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:56.744726 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-69d606d2-1a5b-44c5-874b-952cb3a6d9ae tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:56.745444 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-69d606d2-1a5b-44c5-874b-952cb3a6d9ae tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:56.745993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-69d606d2-1a5b-44c5-874b-952cb3a6d9ae tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:56.752658 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:27:56.928594 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-69d606d2-1a5b-44c5-874b-952cb3a6d9ae tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:56.937001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-69d606d2-1a5b-44c5-874b-952cb3a6d9ae tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1520 microversion: 2.1 time: 0.231461 Oct 24 13:27:56.937586 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 173/347] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:56 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:57.961239 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ec8410ce-5829-4b95-9df7-7a7b910f0ac4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:57.963566 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ec8410ce-5829-4b95-9df7-7a7b910f0ac4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:57.974068 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ec8410ce-5829-4b95-9df7-7a7b910f0ac4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:57.974068 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ec8410ce-5829-4b95-9df7-7a7b910f0ac4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:57.974564 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ec8410ce-5829-4b95-9df7-7a7b910f0ac4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:57.977182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ec8410ce-5829-4b95-9df7-7a7b910f0ac4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:57.977935 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ec8410ce-5829-4b95-9df7-7a7b910f0ac4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:57.978776 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ec8410ce-5829-4b95-9df7-7a7b910f0ac4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:58.274395 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ec8410ce-5829-4b95-9df7-7a7b910f0ac4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:58.282955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ec8410ce-5829-4b95-9df7-7a7b910f0ac4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1520 microversion: 2.1 time: 0.327098 Oct 24 13:27:58.301095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 175/348] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:57 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1520 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:59.307567 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e99248eb-462e-44cb-9fdb-07f5130614a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:59.308960 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e99248eb-462e-44cb-9fdb-07f5130614a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:59.317040 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e99248eb-462e-44cb-9fdb-07f5130614a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:59.318099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e99248eb-462e-44cb-9fdb-07f5130614a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:59.318635 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e99248eb-462e-44cb-9fdb-07f5130614a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:59.319439 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e99248eb-462e-44cb-9fdb-07f5130614a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:59.319997 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e99248eb-462e-44cb-9fdb-07f5130614a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:59.320560 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e99248eb-462e-44cb-9fdb-07f5130614a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:59.493155 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e99248eb-462e-44cb-9fdb-07f5130614a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:59.504245 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e99248eb-462e-44cb-9fdb-07f5130614a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1520 microversion: 2.1 time: 0.201090 Oct 24 13:27:59.505701 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 174/349] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:59 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:00.529207 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-31fc5f13-97eb-44fb-b5ca-bf44c5582210 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:00.529976 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-31fc5f13-97eb-44fb-b5ca-bf44c5582210 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:00.536445 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-31fc5f13-97eb-44fb-b5ca-bf44c5582210 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:00.536915 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-31fc5f13-97eb-44fb-b5ca-bf44c5582210 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:00.537550 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-31fc5f13-97eb-44fb-b5ca-bf44c5582210 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:00.538278 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-31fc5f13-97eb-44fb-b5ca-bf44c5582210 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:00.538727 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-31fc5f13-97eb-44fb-b5ca-bf44c5582210 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:00.539138 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-31fc5f13-97eb-44fb-b5ca-bf44c5582210 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:00.680637 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-31fc5f13-97eb-44fb-b5ca-bf44c5582210 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:00.691370 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-31fc5f13-97eb-44fb-b5ca-bf44c5582210 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1520 microversion: 2.1 time: 0.166522 Oct 24 13:28:00.692295 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 176/350] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:00 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:01.715760 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-84e172c4-47bc-4b35-b7cb-639938bd7c72 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:01.717360 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-84e172c4-47bc-4b35-b7cb-639938bd7c72 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:01.745372 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-84e172c4-47bc-4b35-b7cb-639938bd7c72 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:01.755637 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-84e172c4-47bc-4b35-b7cb-639938bd7c72 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:01.755637 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-84e172c4-47bc-4b35-b7cb-639938bd7c72 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:01.755637 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-84e172c4-47bc-4b35-b7cb-639938bd7c72 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:01.755637 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-84e172c4-47bc-4b35-b7cb-639938bd7c72 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:01.756036 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-84e172c4-47bc-4b35-b7cb-639938bd7c72 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:02.018402 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-84e172c4-47bc-4b35-b7cb-639938bd7c72 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:02.039687 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-84e172c4-47bc-4b35-b7cb-639938bd7c72 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1520 microversion: 2.1 time: 0.318210 Oct 24 13:28:02.058321 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 175/351] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:01 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1520 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:03.063767 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6701cec1-853f-4428-853f-d868791cdefc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:03.064417 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-6701cec1-853f-4428-853f-d868791cdefc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:03.070463 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6701cec1-853f-4428-853f-d868791cdefc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:03.071024 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6701cec1-853f-4428-853f-d868791cdefc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:03.071372 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6701cec1-853f-4428-853f-d868791cdefc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:03.072055 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6701cec1-853f-4428-853f-d868791cdefc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:03.072803 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6701cec1-853f-4428-853f-d868791cdefc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:03.073282 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6701cec1-853f-4428-853f-d868791cdefc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:03.219839 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-6701cec1-853f-4428-853f-d868791cdefc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:03.229145 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6701cec1-853f-4428-853f-d868791cdefc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1520 microversion: 2.1 time: 0.169961 Oct 24 13:28:03.229723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 177/352] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:03 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:04.253455 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-333b536b-4313-47d4-b082-f026194bc5fc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:04.253920 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-333b536b-4313-47d4-b082-f026194bc5fc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:04.263683 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-333b536b-4313-47d4-b082-f026194bc5fc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:04.264182 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-333b536b-4313-47d4-b082-f026194bc5fc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:04.264640 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-333b536b-4313-47d4-b082-f026194bc5fc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:04.268055 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-333b536b-4313-47d4-b082-f026194bc5fc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:04.268539 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-333b536b-4313-47d4-b082-f026194bc5fc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:04.268971 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-333b536b-4313-47d4-b082-f026194bc5fc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:04.650980 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-333b536b-4313-47d4-b082-f026194bc5fc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:04.659162 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-333b536b-4313-47d4-b082-f026194bc5fc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1520 microversion: 2.1 time: 0.410519 Oct 24 13:28:04.659982 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 176/353] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:04 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1520 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:05.686027 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-fcd6679c-effd-452e-a35c-d8315e6340e0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:05.686758 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-fcd6679c-effd-452e-a35c-d8315e6340e0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:05.720325 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fcd6679c-effd-452e-a35c-d8315e6340e0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:05.723162 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fcd6679c-effd-452e-a35c-d8315e6340e0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:05.723893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fcd6679c-effd-452e-a35c-d8315e6340e0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:05.725789 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fcd6679c-effd-452e-a35c-d8315e6340e0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:05.726269 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fcd6679c-effd-452e-a35c-d8315e6340e0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:05.726694 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fcd6679c-effd-452e-a35c-d8315e6340e0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:06.201366 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-fcd6679c-effd-452e-a35c-d8315e6340e0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:06.215871 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-fcd6679c-effd-452e-a35c-d8315e6340e0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1520 microversion: 2.1 time: 0.528583 Oct 24 13:28:06.236430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 178/354] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:05 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1520 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:07.235420 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-28d60496-a532-4ed6-940b-f6004c45d074 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:07.239795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-28d60496-a532-4ed6-940b-f6004c45d074 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:07.253580 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-28d60496-a532-4ed6-940b-f6004c45d074 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:07.256583 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-28d60496-a532-4ed6-940b-f6004c45d074 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:07.257071 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-28d60496-a532-4ed6-940b-f6004c45d074 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:07.258032 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-28d60496-a532-4ed6-940b-f6004c45d074 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:07.258713 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-28d60496-a532-4ed6-940b-f6004c45d074 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:07.260058 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-28d60496-a532-4ed6-940b-f6004c45d074 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:07.572610 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-28d60496-a532-4ed6-940b-f6004c45d074 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:07.584940 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-28d60496-a532-4ed6-940b-f6004c45d074 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1520 microversion: 2.1 time: 0.353481 Oct 24 13:28:07.588071 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 177/355] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:07 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1520 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:08.611011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9bb8abdd-05b6-4eac-80a0-6f5821e1d4d0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:08.612747 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9bb8abdd-05b6-4eac-80a0-6f5821e1d4d0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:08.625430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9bb8abdd-05b6-4eac-80a0-6f5821e1d4d0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:08.626641 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9bb8abdd-05b6-4eac-80a0-6f5821e1d4d0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:08.627694 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9bb8abdd-05b6-4eac-80a0-6f5821e1d4d0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:08.628592 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9bb8abdd-05b6-4eac-80a0-6f5821e1d4d0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:08.629204 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9bb8abdd-05b6-4eac-80a0-6f5821e1d4d0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:08.631043 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9bb8abdd-05b6-4eac-80a0-6f5821e1d4d0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:08.944951 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9bb8abdd-05b6-4eac-80a0-6f5821e1d4d0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:08.968636 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9bb8abdd-05b6-4eac-80a0-6f5821e1d4d0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1500 microversion: 2.1 time: 0.362396 Oct 24 13:28:08.969241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 179/356] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:08 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1500 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:08.996108 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e91a211c-71c9-42dd-a1b3-49b1fa1427ff tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f360be68-5758-401a-b95e-8d11eb8af3ab"}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:28:08.999196 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e91a211c-71c9-42dd-a1b3-49b1fa1427ff tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:09.023716 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e91a211c-71c9-42dd-a1b3-49b1fa1427ff tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:09.026420 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e91a211c-71c9-42dd-a1b3-49b1fa1427ff tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:09.027501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e91a211c-71c9-42dd-a1b3-49b1fa1427ff tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:09.028248 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e91a211c-71c9-42dd-a1b3-49b1fa1427ff tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:09.031648 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e91a211c-71c9-42dd-a1b3-49b1fa1427ff tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:09.032326 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e91a211c-71c9-42dd-a1b3-49b1fa1427ff tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:09.089292 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-e91a211c-71c9-42dd-a1b3-49b1fa1427ff tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] HTTP exception thrown: Cannot 'attach_volume' instance 48b2c12f-1e60-4000-ac5c-d7a5864939a1 while it is in vm_state rescued Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e91a211c-71c9-42dd-a1b3-49b1fa1427ff tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Request method failure captured: Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: POST /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1/os-volume_attachments HTTP/1.1 Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 74 Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpJKIq5Rg50YSGQIjea3FRN8mTaXpsN5dA41WiaGbVh9lcQUtvdp2bBedjxQrf6lA7EHcL6QKUXInDPdjkl_Ihu9evaGWoTz8qUtj4HiB1zTeWk0JDMERKf8vFbcZFV6NCEsUhI2fpefVy7T0gdhukP3dZAyqmypjxu54EdjX60vHfw Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 986792b802264c748e4614c4d2a17680 Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-440406220 Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:28:09.097005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:28:09.098289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_986792b802264c748e4614c4d2a17680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/986792b802264c748e4614c4d2a17680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/986792b802264c748e4614c4d2a17680"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/986792b802264c748e4614c4d2a17680"}]}] Oct 24 13:28:09.098289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-ServerRescueNegativeTestJSON-440406220 Oct 24 13:28:09.098289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 986792b802264c748e4614c4d2a17680 Oct 24 13:28:09.098289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-440406220 Oct 24 13:28:09.098289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-ServerRescueNegativeTestJSON-440406220-project Oct 24 13:28:09.098289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:28:09.098289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:28:09.098289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 633c6c68e15f4be9a7289d15cac9de43 Oct 24 13:28:09.098289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-ServerRescueNegativeTestJSON-440406220-project Oct 24 13:28:09.098289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Oct 24 13:28:09.098289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {"volumeAttachment": {"volumeId": "f360be68-5758-401a-b95e-8d11eb8af3ab"}} Oct 24 13:28:09.098289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:28:09.098994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Cannot 'attach_volume' instance 48b2c12f-1e60-4000-ac5c-d7a5864939a1 while it is in vm_state rescued Oct 24 13:28:09.098994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'server_id': '48b2c12f-1e60-4000-ac5c-d7a5864939a1', 'body': {'volumeAttachment': {'volumeId': 'f360be68-5758-401a-b95e-8d11eb8af3ab'}}} Oct 24 13:28:09.098994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:28:09.098994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:28:09.098994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 24 13:28:09.098994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 24 13:28:09.098994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 13:28:09.098994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 13:28:09.098994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 13:28:09.098994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 13:28:09.098994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 48b2c12f-1e60-4000-ac5c-d7a5864939a1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 24 13:28:09.098994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:28:09.098994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:28:09.098994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:28:09.098994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:28:09.098994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:28:09.098994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:28:09.098994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:28:09.098994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:28:09.100076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:28:09.100076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:28:09.100076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:28:09.100076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:28:09.100076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:28:09.100076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:28:09.100076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:28:09.100076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:28:09.100076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 24 13:28:09.100076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 13:28:09.100076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 13:28:09.100076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 13:28:09.100076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 48b2c12f-1e60-4000-ac5c-d7a5864939a1 while it is in vm_state rescued Oct 24 13:28:09.100076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:28:09.100076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:28:09.100076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:28:09.100076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:28:09.100076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:28:09.100076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:28:09.101233 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:28:09.101233 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:28:09.101233 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 48b2c12f-1e60-4000-ac5c-d7a5864939a1 while it is in vm_state rescued Oct 24 13:28:09.101233 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:28:09.105047 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e91a211c-71c9-42dd-a1b3-49b1fa1427ff tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Returning 409 to user: Cannot 'attach_volume' instance 48b2c12f-1e60-4000-ac5c-d7a5864939a1 while it is in vm_state rescued {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:28:09.109204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e91a211c-71c9-42dd-a1b3-49b1fa1427ff tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "POST /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.119204 Oct 24 13:28:09.110024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 178/357] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 24 13:28:08 2022] POST /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1/os-volume_attachments => generated 152 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 13:28:09.119158 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-596c9d40-fce9-4b2f-8a72-4d4132b1d563 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:28:09.120013 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-596c9d40-fce9-4b2f-8a72-4d4132b1d563 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:09.131246 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-596c9d40-fce9-4b2f-8a72-4d4132b1d563 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:09.131246 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-596c9d40-fce9-4b2f-8a72-4d4132b1d563 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:09.131246 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-596c9d40-fce9-4b2f-8a72-4d4132b1d563 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:09.131246 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-596c9d40-fce9-4b2f-8a72-4d4132b1d563 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:09.132015 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-596c9d40-fce9-4b2f-8a72-4d4132b1d563 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:09.132015 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-596c9d40-fce9-4b2f-8a72-4d4132b1d563 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:09.605147 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-596c9d40-fce9-4b2f-8a72-4d4132b1d563 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "POST /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1/action" status: 202 len: 0 microversion: 2.1 time: 0.490023 Oct 24 13:28:09.615015 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 180/358] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 24 13:28:09 2022] POST /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 13:28:09.620950 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-edfeacbe-6ae5-46ba-9634-95d400ae9435 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:09.621569 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-edfeacbe-6ae5-46ba-9634-95d400ae9435 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:09.636002 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-edfeacbe-6ae5-46ba-9634-95d400ae9435 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:09.636463 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-edfeacbe-6ae5-46ba-9634-95d400ae9435 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:09.636895 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-edfeacbe-6ae5-46ba-9634-95d400ae9435 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:09.637597 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-edfeacbe-6ae5-46ba-9634-95d400ae9435 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:09.638046 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-edfeacbe-6ae5-46ba-9634-95d400ae9435 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:09.638466 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-edfeacbe-6ae5-46ba-9634-95d400ae9435 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:10.268530 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-edfeacbe-6ae5-46ba-9634-95d400ae9435 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:10.288070 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-edfeacbe-6ae5-46ba-9634-95d400ae9435 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1508 microversion: 2.1 time: 0.670674 Oct 24 13:28:10.290915 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 179/359] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:09 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1508 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:11.317649 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-db84e176-8cba-4642-95ee-c2ebeba366f0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:11.318099 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-db84e176-8cba-4642-95ee-c2ebeba366f0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:11.330671 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-db84e176-8cba-4642-95ee-c2ebeba366f0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:11.331548 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-db84e176-8cba-4642-95ee-c2ebeba366f0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:11.332184 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-db84e176-8cba-4642-95ee-c2ebeba366f0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:11.333109 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-db84e176-8cba-4642-95ee-c2ebeba366f0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:11.333974 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-db84e176-8cba-4642-95ee-c2ebeba366f0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:11.334609 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-db84e176-8cba-4642-95ee-c2ebeba366f0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:11.499937 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-db84e176-8cba-4642-95ee-c2ebeba366f0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:11.508154 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-db84e176-8cba-4642-95ee-c2ebeba366f0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1508 microversion: 2.1 time: 0.197839 Oct 24 13:28:11.509046 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 181/360] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:11 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:12.532251 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bb2f2315-f1a0-4a07-afa7-ad89bc94b041 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:12.532887 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bb2f2315-f1a0-4a07-afa7-ad89bc94b041 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:12.555604 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb2f2315-f1a0-4a07-afa7-ad89bc94b041 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:12.560342 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb2f2315-f1a0-4a07-afa7-ad89bc94b041 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:12.560342 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb2f2315-f1a0-4a07-afa7-ad89bc94b041 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:12.560342 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb2f2315-f1a0-4a07-afa7-ad89bc94b041 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:12.560342 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb2f2315-f1a0-4a07-afa7-ad89bc94b041 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:12.560708 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb2f2315-f1a0-4a07-afa7-ad89bc94b041 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:12.843537 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-bb2f2315-f1a0-4a07-afa7-ad89bc94b041 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:12.855264 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-bb2f2315-f1a0-4a07-afa7-ad89bc94b041 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1508 microversion: 2.1 time: 0.326035 Oct 24 13:28:12.858233 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 180/361] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:12 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1508 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:13.878660 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-4335b326-8bf2-470f-9f52-0928b1fb4728 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:13.881473 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-4335b326-8bf2-470f-9f52-0928b1fb4728 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:13.885488 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4335b326-8bf2-470f-9f52-0928b1fb4728 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:13.886295 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4335b326-8bf2-470f-9f52-0928b1fb4728 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:13.886968 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4335b326-8bf2-470f-9f52-0928b1fb4728 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:13.887898 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4335b326-8bf2-470f-9f52-0928b1fb4728 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:13.888591 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4335b326-8bf2-470f-9f52-0928b1fb4728 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:13.889230 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4335b326-8bf2-470f-9f52-0928b1fb4728 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:14.238388 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-4335b326-8bf2-470f-9f52-0928b1fb4728 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:14.247015 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-4335b326-8bf2-470f-9f52-0928b1fb4728 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1508 microversion: 2.1 time: 0.371986 Oct 24 13:28:14.248074 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 182/362] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:13 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1508 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:15.277874 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f10345f9-394d-4a9e-8af4-8019416e956d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:15.279218 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f10345f9-394d-4a9e-8af4-8019416e956d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:15.295176 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f10345f9-394d-4a9e-8af4-8019416e956d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:15.296526 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f10345f9-394d-4a9e-8af4-8019416e956d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:15.297427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f10345f9-394d-4a9e-8af4-8019416e956d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:15.299325 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f10345f9-394d-4a9e-8af4-8019416e956d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:15.300125 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f10345f9-394d-4a9e-8af4-8019416e956d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:15.300901 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f10345f9-394d-4a9e-8af4-8019416e956d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:15.598647 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f10345f9-394d-4a9e-8af4-8019416e956d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:15.608012 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f10345f9-394d-4a9e-8af4-8019416e956d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1514 microversion: 2.1 time: 0.336179 Oct 24 13:28:15.622273 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 181/363] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:15 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1514 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:16.434717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ffdde6a0-4016-4d5e-bb1e-45333b6edf0e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1646122791", "imageRef": "1a874490-179e-412c-895e-52b16935c04c", "flavorRef": "452", "networks": [{"uuid": "fbe543ba-56bd-431b-a00d-2cf1782321b0"}]}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:28:16.582223 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.network.neutron [None req-ffdde6a0-4016-4d5e-bb1e-45333b6edf0e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] validate_networks() for [('fbe543ba-56bd-431b-a00d-2cf1782321b0', None, None, None, None, None)] {{(pid=119145) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:28:17.271513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-ffdde6a0-4016-4d5e-bb1e-45333b6edf0e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Flavor limits 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:28:17.271931 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-ffdde6a0-4016-4d5e-bb1e-45333b6edf0e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Image limits 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:28:17.272602 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-ffdde6a0-4016-4d5e-bb1e-45333b6edf0e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Flavor pref 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:28:17.273013 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-ffdde6a0-4016-4d5e-bb1e-45333b6edf0e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Image pref 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:28:17.273445 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-ffdde6a0-4016-4d5e-bb1e-45333b6edf0e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:28:17.289924 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ffdde6a0-4016-4d5e-bb1e-45333b6edf0e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:17.290419 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ffdde6a0-4016-4d5e-bb1e-45333b6edf0e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:17.291094 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ffdde6a0-4016-4d5e-bb1e-45333b6edf0e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:17.293140 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ffdde6a0-4016-4d5e-bb1e-45333b6edf0e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:17.296528 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ffdde6a0-4016-4d5e-bb1e-45333b6edf0e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:17.297207 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ffdde6a0-4016-4d5e-bb1e-45333b6edf0e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:17.333833 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-ffdde6a0-4016-4d5e-bb1e-45333b6edf0e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Getting quotas for project 10316acf2adf4f34a63a08f0e60b2548. Resources: {'ram', 'instances', 'cores'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:28:17.338308 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-ffdde6a0-4016-4d5e-bb1e-45333b6edf0e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Getting quotas for user feb837dc77134d96be67f955683b2d7d and project 10316acf2adf4f34a63a08f0e60b2548. Resources: {'ram', 'instances', 'cores'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:28:17.351959 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ffdde6a0-4016-4d5e-bb1e-45333b6edf0e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Going to run 1 instances... {{(pid=119145) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:28:17.358118 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ffdde6a0-4016-4d5e-bb1e-45333b6edf0e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a874490-179e-412c-895e-52b16935c04c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119145) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:28:17.489285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ffdde6a0-4016-4d5e-bb1e-45333b6edf0e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.061545 Oct 24 13:28:17.501752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7ae98651-3d73-4ddb-b84c-53edc92e3a22 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:17.503009 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7ae98651-3d73-4ddb-b84c-53edc92e3a22 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:17.509939 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 183/364] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 24 13:28:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 13:28:17.589957 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7ae98651-3d73-4ddb-b84c-53edc92e3a22 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:17.599948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7ae98651-3d73-4ddb-b84c-53edc92e3a22 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1214 microversion: 2.1 time: 0.102259 Oct 24 13:28:17.600578 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 182/365] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:17 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:18.622548 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-802211d0-cbbc-49f4-96c8-bc1a40ef0f46 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:18.623491 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-802211d0-cbbc-49f4-96c8-bc1a40ef0f46 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:18.704065 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-802211d0-cbbc-49f4-96c8-bc1a40ef0f46 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:18.714945 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-802211d0-cbbc-49f4-96c8-bc1a40ef0f46 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1214 microversion: 2.1 time: 0.096544 Oct 24 13:28:18.716477 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 184/366] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:18 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:18.881820 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7fcbdb07-4da1-4078-8164-b52e1f3c6e02 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Action: 'create', calling method: .version_select at 0x7f17a81ffb80>, body: {"keypair": {"name": "tempest-keypair-2049818280", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnwGi7f71jeXPxCQNlj9XB5aDhwmNhSynTPRNsEYungilD/8/ri8C42lr8IQCX2bhiIuAcLjG2VwG/qZnonp5LukP88/B1ZsOLPPUYTOUuRQpZV7MEcRgVeIBhNXdPT4g=="}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:28:18.900556 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-7fcbdb07-4da1-4078-8164-b52e1f3c6e02 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Getting quotas for project 986792b802264c748e4614c4d2a17680. Resources: {'key_pairs'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:28:18.905632 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-7fcbdb07-4da1-4078-8164-b52e1f3c6e02 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Getting quotas for user 633c6c68e15f4be9a7289d15cac9de43 and project 986792b802264c748e4614c4d2a17680. Resources: {'key_pairs'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:28:18.991226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7fcbdb07-4da1-4078-8164-b52e1f3c6e02 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113389 Oct 24 13:28:18.992440 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 183/367] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 24 13:28:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:28:19.756026 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-71099e0d-2c00-4445-a557-7f4edd578373 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:19.756026 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-71099e0d-2c00-4445-a557-7f4edd578373 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:19.756902 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-71099e0d-2c00-4445-a557-7f4edd578373 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:19.757173 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-71099e0d-2c00-4445-a557-7f4edd578373 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:19.757861 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-71099e0d-2c00-4445-a557-7f4edd578373 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:19.759143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-71099e0d-2c00-4445-a557-7f4edd578373 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:19.759853 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-71099e0d-2c00-4445-a557-7f4edd578373 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:19.760600 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-71099e0d-2c00-4445-a557-7f4edd578373 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:19.869919 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-71099e0d-2c00-4445-a557-7f4edd578373 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:19.872697 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:19.881803 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-71099e0d-2c00-4445-a557-7f4edd578373 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1218 microversion: 2.1 time: 0.137115 Oct 24 13:28:19.896511 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 185/368] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:19 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:20.911977 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ed2c1108-d126-4987-b3f0-2ca219528e8a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:20.913483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-ed2c1108-d126-4987-b3f0-2ca219528e8a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:20.921004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:20.923557 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ed2c1108-d126-4987-b3f0-2ca219528e8a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:20.924421 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ed2c1108-d126-4987-b3f0-2ca219528e8a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:20.925003 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ed2c1108-d126-4987-b3f0-2ca219528e8a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:20.925963 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ed2c1108-d126-4987-b3f0-2ca219528e8a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:20.926565 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ed2c1108-d126-4987-b3f0-2ca219528e8a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:20.926982 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ed2c1108-d126-4987-b3f0-2ca219528e8a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:21.032814 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ed2c1108-d126-4987-b3f0-2ca219528e8a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:21.068152 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-ed2c1108-d126-4987-b3f0-2ca219528e8a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1266 microversion: 2.1 time: 0.162277 Oct 24 13:28:21.080596 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 184/369] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:20 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:22.099969 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8a6c0f7a-80b0-4ca3-bca2-f252225785a1 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:22.100627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-8a6c0f7a-80b0-4ca3-bca2-f252225785a1 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:22.109911 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8a6c0f7a-80b0-4ca3-bca2-f252225785a1 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:22.112892 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8a6c0f7a-80b0-4ca3-bca2-f252225785a1 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:22.112892 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8a6c0f7a-80b0-4ca3-bca2-f252225785a1 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:22.112892 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8a6c0f7a-80b0-4ca3-bca2-f252225785a1 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:22.112892 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8a6c0f7a-80b0-4ca3-bca2-f252225785a1 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:22.113247 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8a6c0f7a-80b0-4ca3-bca2-f252225785a1 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:22.212316 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1e2b3de5-fa93-4e9a-8d67-2ca90a57ca1e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-18773128", "imageRef": "1a874490-179e-412c-895e-52b16935c04c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "66080719-964f-4fc3-8c4a-84b1c81a6ebc"}], "security_groups": [{"name": "tempest-securitygroup--1023587068"}], "key_name": "tempest-keypair-2049818280", "user_data": "}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:28:22.238664 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-8a6c0f7a-80b0-4ca3-bca2-f252225785a1 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:22.247123 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-8a6c0f7a-80b0-4ca3-bca2-f252225785a1 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1272 microversion: 2.1 time: 0.152433 Oct 24 13:28:22.267901 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 186/370] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:22 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1272 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:22.409115 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.network.neutron [None req-1e2b3de5-fa93-4e9a-8d67-2ca90a57ca1e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] validate_networks() for [('66080719-964f-4fc3-8c4a-84b1c81a6ebc', None, None, None, None, None)] {{(pid=119146) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:28:22.933284 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-1e2b3de5-fa93-4e9a-8d67-2ca90a57ca1e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Flavor limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:28:22.933702 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-1e2b3de5-fa93-4e9a-8d67-2ca90a57ca1e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Image limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:28:22.934194 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-1e2b3de5-fa93-4e9a-8d67-2ca90a57ca1e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Flavor pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:28:22.934594 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-1e2b3de5-fa93-4e9a-8d67-2ca90a57ca1e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Image pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:28:22.934994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-1e2b3de5-fa93-4e9a-8d67-2ca90a57ca1e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:28:22.944543 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1e2b3de5-fa93-4e9a-8d67-2ca90a57ca1e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:22.945014 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1e2b3de5-fa93-4e9a-8d67-2ca90a57ca1e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:22.945437 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1e2b3de5-fa93-4e9a-8d67-2ca90a57ca1e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:22.946170 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1e2b3de5-fa93-4e9a-8d67-2ca90a57ca1e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:22.951533 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1e2b3de5-fa93-4e9a-8d67-2ca90a57ca1e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:22.953638 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1e2b3de5-fa93-4e9a-8d67-2ca90a57ca1e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:22.977049 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-1e2b3de5-fa93-4e9a-8d67-2ca90a57ca1e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Getting quotas for project 986792b802264c748e4614c4d2a17680. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:28:22.981707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-1e2b3de5-fa93-4e9a-8d67-2ca90a57ca1e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Getting quotas for user 633c6c68e15f4be9a7289d15cac9de43 and project 986792b802264c748e4614c4d2a17680. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:28:22.995344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-1e2b3de5-fa93-4e9a-8d67-2ca90a57ca1e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Going to run 1 instances... {{(pid=119146) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:28:23.000620 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-1e2b3de5-fa93-4e9a-8d67-2ca90a57ca1e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a874490-179e-412c-895e-52b16935c04c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119146) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:28:23.222284 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1e2b3de5-fa93-4e9a-8d67-2ca90a57ca1e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.016116 Oct 24 13:28:23.229431 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 185/371] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 24 13:28:22 2022] POST /compute/v2.1/servers => generated 409 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:28:23.235096 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e5a89ed9-21c0-44e2-bf74-06427ae8be9f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:23.236339 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e5a89ed9-21c0-44e2-bf74-06427ae8be9f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:23.242608 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:23.290259 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3903c45c-147a-4570-b76d-b19c381b5acd tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:23.290879 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-3903c45c-147a-4570-b76d-b19c381b5acd tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:23.306597 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3903c45c-147a-4570-b76d-b19c381b5acd tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:23.307145 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3903c45c-147a-4570-b76d-b19c381b5acd tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:23.307523 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3903c45c-147a-4570-b76d-b19c381b5acd tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:23.309099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3903c45c-147a-4570-b76d-b19c381b5acd tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:23.309330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3903c45c-147a-4570-b76d-b19c381b5acd tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:23.309757 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3903c45c-147a-4570-b76d-b19c381b5acd tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:23.439795 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e5a89ed9-21c0-44e2-bf74-06427ae8be9f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:23.452101 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e5a89ed9-21c0-44e2-bf74-06427ae8be9f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1244 microversion: 2.1 time: 0.217073 Oct 24 13:28:23.452101 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 187/372] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:23 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1244 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:23.527513 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3903c45c-147a-4570-b76d-b19c381b5acd tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:23.536768 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3903c45c-147a-4570-b76d-b19c381b5acd tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.249904 Oct 24 13:28:23.549545 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 186/373] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:23 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:24.364793 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-ce635246-1b33-4125-ab34-8a1c2a7cb439 req-4c4ed359-3848-4dae-b9db-8fdf49bba848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "767060a8-d6d0-40fc-a72e-2c0a900e2217", "tag": "8d669271-6843-457a-b839-d4d358023ded"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:28:24.413463 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-ce635246-1b33-4125-ab34-8a1c2a7cb439 req-4c4ed359-3848-4dae-b9db-8fdf49bba848 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:24.413966 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-ce635246-1b33-4125-ab34-8a1c2a7cb439 req-4c4ed359-3848-4dae-b9db-8fdf49bba848 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:24.414545 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-ce635246-1b33-4125-ab34-8a1c2a7cb439 req-4c4ed359-3848-4dae-b9db-8fdf49bba848 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:24.445554 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-ce635246-1b33-4125-ab34-8a1c2a7cb439 req-4c4ed359-3848-4dae-b9db-8fdf49bba848 service nova] Creating event network-changed:8d669271-6843-457a-b839-d4d358023ded for instance 767060a8-d6d0-40fc-a72e-2c0a900e2217 on hv-cinder-86249 Oct 24 13:28:24.457935 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-ce635246-1b33-4125-ab34-8a1c2a7cb439 req-4c4ed359-3848-4dae-b9db-8fdf49bba848 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097097 Oct 24 13:28:24.458675 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 188/374] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:28:24.471694 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-0e51d813-7679-41bf-859a-51775a7df111 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:24.477112 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-0e51d813-7679-41bf-859a-51775a7df111 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:24.480215 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0e51d813-7679-41bf-859a-51775a7df111 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:24.480762 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0e51d813-7679-41bf-859a-51775a7df111 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:24.481214 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0e51d813-7679-41bf-859a-51775a7df111 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:24.481998 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0e51d813-7679-41bf-859a-51775a7df111 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:24.482452 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0e51d813-7679-41bf-859a-51775a7df111 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:24.482906 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0e51d813-7679-41bf-859a-51775a7df111 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:24.554903 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-0e51d813-7679-41bf-859a-51775a7df111 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:24.562582 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-d3245688-ecf8-4f45-adce-c4729d2c8227 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:24.563521 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-d3245688-ecf8-4f45-adce-c4729d2c8227 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:24.567366 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-0e51d813-7679-41bf-859a-51775a7df111 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1248 microversion: 2.1 time: 0.099513 Oct 24 13:28:24.568408 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 187/375] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:24 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1248 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:24.570624 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d3245688-ecf8-4f45-adce-c4729d2c8227 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:24.571253 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d3245688-ecf8-4f45-adce-c4729d2c8227 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:24.571838 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d3245688-ecf8-4f45-adce-c4729d2c8227 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:24.573374 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d3245688-ecf8-4f45-adce-c4729d2c8227 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:24.573818 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d3245688-ecf8-4f45-adce-c4729d2c8227 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:24.574191 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d3245688-ecf8-4f45-adce-c4729d2c8227 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:24.768810 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-d3245688-ecf8-4f45-adce-c4729d2c8227 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:24.777943 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-d3245688-ecf8-4f45-adce-c4729d2c8227 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.219942 Oct 24 13:28:24.778551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 189/376] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:24 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:25.591094 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-0f100489-9246-4e99-af4e-7292b7e1e3ce tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:25.592460 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-0f100489-9246-4e99-af4e-7292b7e1e3ce tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:25.599042 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0f100489-9246-4e99-af4e-7292b7e1e3ce tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:25.599605 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0f100489-9246-4e99-af4e-7292b7e1e3ce tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:25.600106 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0f100489-9246-4e99-af4e-7292b7e1e3ce tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:25.600897 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0f100489-9246-4e99-af4e-7292b7e1e3ce tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:25.601420 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0f100489-9246-4e99-af4e-7292b7e1e3ce tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:25.601911 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0f100489-9246-4e99-af4e-7292b7e1e3ce tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:25.693501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-0f100489-9246-4e99-af4e-7292b7e1e3ce tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:25.701295 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-0f100489-9246-4e99-af4e-7292b7e1e3ce tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1248 microversion: 2.1 time: 0.114132 Oct 24 13:28:25.716477 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 188/377] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:25 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1248 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:25.802495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9847a361-5a5e-42e1-8882-a5d1004e3ce6 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:25.803246 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9847a361-5a5e-42e1-8882-a5d1004e3ce6 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:25.809504 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9847a361-5a5e-42e1-8882-a5d1004e3ce6 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:25.810423 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9847a361-5a5e-42e1-8882-a5d1004e3ce6 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:25.811509 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9847a361-5a5e-42e1-8882-a5d1004e3ce6 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:25.812416 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9847a361-5a5e-42e1-8882-a5d1004e3ce6 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:25.812933 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9847a361-5a5e-42e1-8882-a5d1004e3ce6 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:25.813428 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9847a361-5a5e-42e1-8882-a5d1004e3ce6 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:25.963637 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9847a361-5a5e-42e1-8882-a5d1004e3ce6 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:25.972672 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9847a361-5a5e-42e1-8882-a5d1004e3ce6 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.174039 Oct 24 13:28:25.973262 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 190/378] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:25 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:26.727191 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-af65e30b-4c37-4a04-86a9-f48788f6df53 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:26.728524 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-af65e30b-4c37-4a04-86a9-f48788f6df53 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:26.734913 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-af65e30b-4c37-4a04-86a9-f48788f6df53 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:26.735386 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-af65e30b-4c37-4a04-86a9-f48788f6df53 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:26.735817 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-af65e30b-4c37-4a04-86a9-f48788f6df53 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:26.736613 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-af65e30b-4c37-4a04-86a9-f48788f6df53 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:26.737064 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-af65e30b-4c37-4a04-86a9-f48788f6df53 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:26.737484 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-af65e30b-4c37-4a04-86a9-f48788f6df53 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:26.801699 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-af65e30b-4c37-4a04-86a9-f48788f6df53 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:26.809352 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-af65e30b-4c37-4a04-86a9-f48788f6df53 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1248 microversion: 2.1 time: 0.086144 Oct 24 13:28:26.809929 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 189/379] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:26 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1248 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:26.998943 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-19ebe867-4336-49f0-8121-0f43b3362388 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:26.999548 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-19ebe867-4336-49f0-8121-0f43b3362388 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:27.005555 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-19ebe867-4336-49f0-8121-0f43b3362388 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:27.006031 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-19ebe867-4336-49f0-8121-0f43b3362388 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:27.006462 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-19ebe867-4336-49f0-8121-0f43b3362388 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:27.007133 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-19ebe867-4336-49f0-8121-0f43b3362388 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:27.007604 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-19ebe867-4336-49f0-8121-0f43b3362388 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:27.008019 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-19ebe867-4336-49f0-8121-0f43b3362388 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:27.149290 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-19ebe867-4336-49f0-8121-0f43b3362388 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:27.159923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-19ebe867-4336-49f0-8121-0f43b3362388 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.162885 Oct 24 13:28:27.172497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 191/380] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:26 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:27.834199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a39d2281-cf49-4e69-8abf-f0b527126130 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:27.834811 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a39d2281-cf49-4e69-8abf-f0b527126130 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:27.843390 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a39d2281-cf49-4e69-8abf-f0b527126130 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:27.844147 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a39d2281-cf49-4e69-8abf-f0b527126130 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:27.844825 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a39d2281-cf49-4e69-8abf-f0b527126130 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:27.845805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a39d2281-cf49-4e69-8abf-f0b527126130 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:27.846458 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a39d2281-cf49-4e69-8abf-f0b527126130 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:27.847613 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a39d2281-cf49-4e69-8abf-f0b527126130 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:27.945634 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a39d2281-cf49-4e69-8abf-f0b527126130 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:27.954656 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a39d2281-cf49-4e69-8abf-f0b527126130 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1248 microversion: 2.1 time: 0.124503 Oct 24 13:28:27.961102 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 190/381] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:27 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1248 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:28.010577 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-65de510e-7ca4-4890-9b95-39f68a2b7a39 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Action: 'create', calling method: .version_select at 0x7f17a81c1dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1950010657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4CzUW9eprLa8XWJT2XKvEzspD8FZHbI022Bs1Wg1oW8cUAAnF9jTCbyx9sem67ihxLDISB5NeEdBs9UT0OAYV2lHvvqQC6IgQhiVo7coHUJOXt6mYVMQaJn6rVz5/5XQ=="}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:28:28.017192 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=2 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:28.028220 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-65de510e-7ca4-4890-9b95-39f68a2b7a39 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Getting quotas for project 1742dccd5a764a31ab1a228ead5cdab9. Resources: {'key_pairs'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:28:28.032916 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-65de510e-7ca4-4890-9b95-39f68a2b7a39 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Getting quotas for user 834b92eb61864d1b95e9f037379c2e13 and project 1742dccd5a764a31ab1a228ead5cdab9. Resources: {'key_pairs'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:28:28.140615 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-65de510e-7ca4-4890-9b95-39f68a2b7a39 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.133827 Oct 24 13:28:28.149277 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 192/382] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 24 13:28:28 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:28:28.184737 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-09235f55-857f-47d5-b96f-d8cac4e9f83a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:28.185346 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-09235f55-857f-47d5-b96f-d8cac4e9f83a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:28.191861 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-09235f55-857f-47d5-b96f-d8cac4e9f83a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:28.192435 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-09235f55-857f-47d5-b96f-d8cac4e9f83a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:28.192863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-09235f55-857f-47d5-b96f-d8cac4e9f83a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:28.193548 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-09235f55-857f-47d5-b96f-d8cac4e9f83a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:28.194167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-09235f55-857f-47d5-b96f-d8cac4e9f83a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:28.194589 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-09235f55-857f-47d5-b96f-d8cac4e9f83a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:28.269496 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-cf33dabe-da9d-4be5-b3c7-052c52452f3d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1500713473", "imageRef": "33e0cbf7-e005-40b2-999e-11ccea9e598d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1950010657", "networks": [{"uuid": "076a8aa0-ff41-4c0b-b28d-07fa6b846e09"}]}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:28:28.323205 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.network.neutron [None req-cf33dabe-da9d-4be5-b3c7-052c52452f3d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] validate_networks() for [('076a8aa0-ff41-4c0b-b28d-07fa6b846e09', None, None, None, None, None)] {{(pid=119145) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:28:28.340486 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-09235f55-857f-47d5-b96f-d8cac4e9f83a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:28.348931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-09235f55-857f-47d5-b96f-d8cac4e9f83a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.167986 Oct 24 13:28:28.352305 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 191/383] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:28 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:28.798949 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-cf33dabe-da9d-4be5-b3c7-052c52452f3d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Flavor limits 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:28:28.799369 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-cf33dabe-da9d-4be5-b3c7-052c52452f3d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Image limits 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:28:28.799961 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-cf33dabe-da9d-4be5-b3c7-052c52452f3d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Flavor pref 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:28:28.800402 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-cf33dabe-da9d-4be5-b3c7-052c52452f3d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Image pref 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:28:28.800805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-cf33dabe-da9d-4be5-b3c7-052c52452f3d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:28:28.813637 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cf33dabe-da9d-4be5-b3c7-052c52452f3d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:28.814205 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cf33dabe-da9d-4be5-b3c7-052c52452f3d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:28.814696 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cf33dabe-da9d-4be5-b3c7-052c52452f3d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:28.815594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cf33dabe-da9d-4be5-b3c7-052c52452f3d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:28.816191 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cf33dabe-da9d-4be5-b3c7-052c52452f3d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:28.816817 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cf33dabe-da9d-4be5-b3c7-052c52452f3d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:28.835324 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-cf33dabe-da9d-4be5-b3c7-052c52452f3d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Getting quotas for project 1742dccd5a764a31ab1a228ead5cdab9. Resources: {'ram', 'instances', 'cores'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:28:28.839966 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-cf33dabe-da9d-4be5-b3c7-052c52452f3d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Getting quotas for user 834b92eb61864d1b95e9f037379c2e13 and project 1742dccd5a764a31ab1a228ead5cdab9. Resources: {'ram', 'instances', 'cores'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:28:28.853181 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-cf33dabe-da9d-4be5-b3c7-052c52452f3d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Going to run 1 instances... {{(pid=119145) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:28:28.855761 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-cf33dabe-da9d-4be5-b3c7-052c52452f3d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33e0cbf7-e005-40b2-999e-11ccea9e598d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119145) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:28:28.978112 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-d624dca8-4882-4d37-9b54-b41632265167 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:28.978957 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-d624dca8-4882-4d37-9b54-b41632265167 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:28.986287 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d624dca8-4882-4d37-9b54-b41632265167 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:28.986861 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d624dca8-4882-4d37-9b54-b41632265167 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:28.987361 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d624dca8-4882-4d37-9b54-b41632265167 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:28.988153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d624dca8-4882-4d37-9b54-b41632265167 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:28.988701 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d624dca8-4882-4d37-9b54-b41632265167 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:28.989499 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d624dca8-4882-4d37-9b54-b41632265167 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:29.004628 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-cf33dabe-da9d-4be5-b3c7-052c52452f3d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743501 Oct 24 13:28:29.011457 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 193/384] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 24 13:28:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:28:29.016436 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-16c9f5f6-a710-428a-84bb-d65fc9bb550a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:29.016849 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-16c9f5f6-a710-428a-84bb-d65fc9bb550a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:29.063508 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-d624dca8-4882-4d37-9b54-b41632265167 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:29.067488 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=100 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:29.078286 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-d624dca8-4882-4d37-9b54-b41632265167 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1240 microversion: 2.1 time: 0.101207 Oct 24 13:28:29.078286 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 192/385] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:28 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1240 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:29.101565 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-16c9f5f6-a710-428a-84bb-d65fc9bb550a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:29.109421 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-16c9f5f6-a710-428a-84bb-d65fc9bb550a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1259 microversion: 2.1 time: 0.096929 Oct 24 13:28:29.109986 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 194/386] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:29 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1259 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:29.374668 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a7696914-1041-4f68-9b82-393c5fc6b2ca tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:29.375704 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a7696914-1041-4f68-9b82-393c5fc6b2ca tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:29.383855 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a7696914-1041-4f68-9b82-393c5fc6b2ca tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:29.384356 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a7696914-1041-4f68-9b82-393c5fc6b2ca tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:29.384867 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a7696914-1041-4f68-9b82-393c5fc6b2ca tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:29.385543 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a7696914-1041-4f68-9b82-393c5fc6b2ca tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:29.385984 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a7696914-1041-4f68-9b82-393c5fc6b2ca tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:29.386394 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a7696914-1041-4f68-9b82-393c5fc6b2ca tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:29.513001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a7696914-1041-4f68-9b82-393c5fc6b2ca tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:29.521193 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a7696914-1041-4f68-9b82-393c5fc6b2ca tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.150874 Oct 24 13:28:29.521888 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 193/387] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:29 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:30.099058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-bf9445c8-c1d8-4a7a-b448-49a235d7c022 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:30.099644 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-bf9445c8-c1d8-4a7a-b448-49a235d7c022 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:30.105888 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bf9445c8-c1d8-4a7a-b448-49a235d7c022 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:30.106403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bf9445c8-c1d8-4a7a-b448-49a235d7c022 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:30.106823 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bf9445c8-c1d8-4a7a-b448-49a235d7c022 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:30.107492 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bf9445c8-c1d8-4a7a-b448-49a235d7c022 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:30.108462 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bf9445c8-c1d8-4a7a-b448-49a235d7c022 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:30.108872 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bf9445c8-c1d8-4a7a-b448-49a235d7c022 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:30.131592 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-30b3853e-0455-493c-a238-749e6753e357 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:30.135125 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-30b3853e-0455-493c-a238-749e6753e357 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:30.170738 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-bf9445c8-c1d8-4a7a-b448-49a235d7c022 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:30.179287 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-bf9445c8-c1d8-4a7a-b448-49a235d7c022 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1296 microversion: 2.1 time: 0.084124 Oct 24 13:28:30.179860 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 195/388] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:30 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1296 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:30.190296 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-30b3853e-0455-493c-a238-749e6753e357 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:30.196453 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-30b3853e-0455-493c-a238-749e6753e357 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1259 microversion: 2.1 time: 0.068798 Oct 24 13:28:30.197043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 194/389] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:30 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:30.544686 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7078c457-dca9-4565-8c68-24a291970782 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:30.545233 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-7078c457-dca9-4565-8c68-24a291970782 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:30.551147 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7078c457-dca9-4565-8c68-24a291970782 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:30.551618 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7078c457-dca9-4565-8c68-24a291970782 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:30.552050 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7078c457-dca9-4565-8c68-24a291970782 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:30.552767 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7078c457-dca9-4565-8c68-24a291970782 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:30.553214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7078c457-dca9-4565-8c68-24a291970782 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:30.553694 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7078c457-dca9-4565-8c68-24a291970782 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:30.680742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-7078c457-dca9-4565-8c68-24a291970782 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:30.688885 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-7078c457-dca9-4565-8c68-24a291970782 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.148228 Oct 24 13:28:30.689452 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 196/390] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:30 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:31.204002 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-05fa513b-1b40-453b-a670-f768b6c253bc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:31.204640 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-05fa513b-1b40-453b-a670-f768b6c253bc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:31.219054 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9b3e612d-b0bd-4198-aad3-3438f7ff8b67 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:31.220231 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9b3e612d-b0bd-4198-aad3-3438f7ff8b67 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:31.223327 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-05fa513b-1b40-453b-a670-f768b6c253bc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:31.223808 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-05fa513b-1b40-453b-a670-f768b6c253bc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:31.224406 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-05fa513b-1b40-453b-a670-f768b6c253bc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:31.231517 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-05fa513b-1b40-453b-a670-f768b6c253bc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:31.231517 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-05fa513b-1b40-453b-a670-f768b6c253bc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:31.231517 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-05fa513b-1b40-453b-a670-f768b6c253bc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:31.232048 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9b3e612d-b0bd-4198-aad3-3438f7ff8b67 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:31.232048 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9b3e612d-b0bd-4198-aad3-3438f7ff8b67 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:31.232048 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9b3e612d-b0bd-4198-aad3-3438f7ff8b67 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:31.232048 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9b3e612d-b0bd-4198-aad3-3438f7ff8b67 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:31.232357 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9b3e612d-b0bd-4198-aad3-3438f7ff8b67 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:31.232357 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9b3e612d-b0bd-4198-aad3-3438f7ff8b67 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:31.292216 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9b3e612d-b0bd-4198-aad3-3438f7ff8b67 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:31.298152 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-05fa513b-1b40-453b-a670-f768b6c253bc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:31.301564 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9b3e612d-b0bd-4198-aad3-3438f7ff8b67 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1263 microversion: 2.1 time: 0.086352 Oct 24 13:28:31.304564 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 197/391] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:31 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1263 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:31.306313 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-05fa513b-1b40-453b-a670-f768b6c253bc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1296 microversion: 2.1 time: 0.107236 Oct 24 13:28:31.306871 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 195/392] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:31 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1296 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:31.711433 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0340e268-596f-4744-b563-59b2e316628f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:31.712033 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0340e268-596f-4744-b563-59b2e316628f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:31.718565 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0340e268-596f-4744-b563-59b2e316628f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:31.719027 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0340e268-596f-4744-b563-59b2e316628f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:31.719446 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0340e268-596f-4744-b563-59b2e316628f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:31.720107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0340e268-596f-4744-b563-59b2e316628f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:31.720575 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0340e268-596f-4744-b563-59b2e316628f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:31.720986 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0340e268-596f-4744-b563-59b2e316628f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:31.843949 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0340e268-596f-4744-b563-59b2e316628f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:31.851518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0340e268-596f-4744-b563-59b2e316628f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.143895 Oct 24 13:28:31.852078 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 198/393] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:31 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:32.326042 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-4a347cef-f7fd-44d5-aa8e-1361bbd506fd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:32.327434 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-4a347cef-f7fd-44d5-aa8e-1361bbd506fd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:32.329746 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-35e006a8-425e-495f-9445-194213e1ca9c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:32.330824 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-35e006a8-425e-495f-9445-194213e1ca9c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:32.333944 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4a347cef-f7fd-44d5-aa8e-1361bbd506fd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:32.334353 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4a347cef-f7fd-44d5-aa8e-1361bbd506fd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:32.334778 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4a347cef-f7fd-44d5-aa8e-1361bbd506fd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:32.335493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4a347cef-f7fd-44d5-aa8e-1361bbd506fd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:32.335973 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4a347cef-f7fd-44d5-aa8e-1361bbd506fd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:32.336417 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4a347cef-f7fd-44d5-aa8e-1361bbd506fd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:32.336534 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-35e006a8-425e-495f-9445-194213e1ca9c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:32.336922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-35e006a8-425e-495f-9445-194213e1ca9c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:32.337382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-35e006a8-425e-495f-9445-194213e1ca9c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:32.338063 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-35e006a8-425e-495f-9445-194213e1ca9c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:32.338511 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-35e006a8-425e-495f-9445-194213e1ca9c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:32.338929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-35e006a8-425e-495f-9445-194213e1ca9c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:32.398365 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-4a347cef-f7fd-44d5-aa8e-1361bbd506fd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:32.405456 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-35e006a8-425e-495f-9445-194213e1ca9c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:32.407103 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-4a347cef-f7fd-44d5-aa8e-1361bbd506fd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1263 microversion: 2.1 time: 0.085289 Oct 24 13:28:32.407747 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 196/394] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:32 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1263 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:32.413062 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-35e006a8-425e-495f-9445-194213e1ca9c tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1296 microversion: 2.1 time: 0.088120 Oct 24 13:28:32.413616 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 199/395] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:32 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1296 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:32.874107 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f166e62b-1c03-4a90-9aea-ceadb182f7ca tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:32.874690 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f166e62b-1c03-4a90-9aea-ceadb182f7ca tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:32.880755 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f166e62b-1c03-4a90-9aea-ceadb182f7ca tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:32.881085 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f166e62b-1c03-4a90-9aea-ceadb182f7ca tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:32.881506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f166e62b-1c03-4a90-9aea-ceadb182f7ca tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:32.882168 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f166e62b-1c03-4a90-9aea-ceadb182f7ca tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:32.882608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f166e62b-1c03-4a90-9aea-ceadb182f7ca tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:32.883022 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f166e62b-1c03-4a90-9aea-ceadb182f7ca tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:32.963356 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=2 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:33.011322 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f166e62b-1c03-4a90-9aea-ceadb182f7ca tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:33.019223 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f166e62b-1c03-4a90-9aea-ceadb182f7ca tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.149042 Oct 24 13:28:33.019781 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 197/396] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:32 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:33.429838 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-90c86942-28de-475b-ab58-fb68e27fc5f7 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:33.430666 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-90c86942-28de-475b-ab58-fb68e27fc5f7 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:33.435164 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-53d58afd-b284-41ba-ad84-b2ab721a0873 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:33.435805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-53d58afd-b284-41ba-ad84-b2ab721a0873 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:33.436622 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-90c86942-28de-475b-ab58-fb68e27fc5f7 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:33.437094 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-90c86942-28de-475b-ab58-fb68e27fc5f7 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:33.437518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-90c86942-28de-475b-ab58-fb68e27fc5f7 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:33.438195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-90c86942-28de-475b-ab58-fb68e27fc5f7 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:33.438645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-90c86942-28de-475b-ab58-fb68e27fc5f7 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:33.439064 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-90c86942-28de-475b-ab58-fb68e27fc5f7 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:33.442345 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53d58afd-b284-41ba-ad84-b2ab721a0873 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:33.442815 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53d58afd-b284-41ba-ad84-b2ab721a0873 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:33.443248 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53d58afd-b284-41ba-ad84-b2ab721a0873 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:33.443903 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53d58afd-b284-41ba-ad84-b2ab721a0873 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:33.444369 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53d58afd-b284-41ba-ad84-b2ab721a0873 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:33.444823 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53d58afd-b284-41ba-ad84-b2ab721a0873 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:33.500396 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-90c86942-28de-475b-ab58-fb68e27fc5f7 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:33.504515 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-53d58afd-b284-41ba-ad84-b2ab721a0873 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:33.508217 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-90c86942-28de-475b-ab58-fb68e27fc5f7 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1263 microversion: 2.1 time: 0.082182 Oct 24 13:28:33.508824 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 200/397] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:33 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:33.512379 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-53d58afd-b284-41ba-ad84-b2ab721a0873 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1296 microversion: 2.1 time: 0.080926 Oct 24 13:28:33.512969 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 198/398] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:33 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1296 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:34.042617 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-2543eb63-ab42-4f02-855e-8bb5afaf3f70 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:34.043223 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-2543eb63-ab42-4f02-855e-8bb5afaf3f70 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:34.049085 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2543eb63-ab42-4f02-855e-8bb5afaf3f70 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:34.049554 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2543eb63-ab42-4f02-855e-8bb5afaf3f70 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:34.049972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2543eb63-ab42-4f02-855e-8bb5afaf3f70 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:34.050707 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2543eb63-ab42-4f02-855e-8bb5afaf3f70 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:34.051149 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2543eb63-ab42-4f02-855e-8bb5afaf3f70 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:34.051557 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2543eb63-ab42-4f02-855e-8bb5afaf3f70 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:34.176437 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-2543eb63-ab42-4f02-855e-8bb5afaf3f70 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:34.184089 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-2543eb63-ab42-4f02-855e-8bb5afaf3f70 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.145518 Oct 24 13:28:34.184680 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 201/399] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:34 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:34.530874 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b067ca07-ec42-4f9c-9bb7-6c6b57849207 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:34.531596 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b067ca07-ec42-4f9c-9bb7-6c6b57849207 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:34.534633 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7e377155-6427-4f08-9332-6e891d811d51 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:34.535244 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-7e377155-6427-4f08-9332-6e891d811d51 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:34.538063 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b067ca07-ec42-4f9c-9bb7-6c6b57849207 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:34.538549 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b067ca07-ec42-4f9c-9bb7-6c6b57849207 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:34.538977 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b067ca07-ec42-4f9c-9bb7-6c6b57849207 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:34.539667 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b067ca07-ec42-4f9c-9bb7-6c6b57849207 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:34.540120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b067ca07-ec42-4f9c-9bb7-6c6b57849207 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:34.540568 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b067ca07-ec42-4f9c-9bb7-6c6b57849207 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:34.541453 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7e377155-6427-4f08-9332-6e891d811d51 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:34.541926 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7e377155-6427-4f08-9332-6e891d811d51 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:34.542349 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7e377155-6427-4f08-9332-6e891d811d51 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:34.543023 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7e377155-6427-4f08-9332-6e891d811d51 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:34.543464 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7e377155-6427-4f08-9332-6e891d811d51 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:34.543874 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7e377155-6427-4f08-9332-6e891d811d51 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:34.602002 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b067ca07-ec42-4f9c-9bb7-6c6b57849207 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:34.608801 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-7e377155-6427-4f08-9332-6e891d811d51 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:34.612198 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b067ca07-ec42-4f9c-9bb7-6c6b57849207 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1263 microversion: 2.1 time: 0.083585 Oct 24 13:28:34.612198 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 199/400] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:34 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1263 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:34.616717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-7e377155-6427-4f08-9332-6e891d811d51 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1296 microversion: 2.1 time: 0.085751 Oct 24 13:28:34.617270 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 202/401] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:34 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1296 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:35.207911 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-26a74e58-b5ff-4d5f-ad8d-45e38379414a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:35.208561 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-26a74e58-b5ff-4d5f-ad8d-45e38379414a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:35.214499 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-26a74e58-b5ff-4d5f-ad8d-45e38379414a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:35.214968 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-26a74e58-b5ff-4d5f-ad8d-45e38379414a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:35.215390 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-26a74e58-b5ff-4d5f-ad8d-45e38379414a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:35.216057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-26a74e58-b5ff-4d5f-ad8d-45e38379414a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:35.216525 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-26a74e58-b5ff-4d5f-ad8d-45e38379414a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:35.217730 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-26a74e58-b5ff-4d5f-ad8d-45e38379414a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:35.342877 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-26a74e58-b5ff-4d5f-ad8d-45e38379414a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:35.350875 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-26a74e58-b5ff-4d5f-ad8d-45e38379414a tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.146781 Oct 24 13:28:35.351439 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 200/402] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:35 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:35.633451 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-18b395c6-d859-45d7-ad07-5ab35279b032 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:35.634117 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-18b395c6-d859-45d7-ad07-5ab35279b032 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:35.640778 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-18b395c6-d859-45d7-ad07-5ab35279b032 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:35.640947 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-0bccaf57-01d2-4db1-8fe9-c8356a274a81 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:35.641342 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-18b395c6-d859-45d7-ad07-5ab35279b032 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:35.641447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-0bccaf57-01d2-4db1-8fe9-c8356a274a81 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:35.641694 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-18b395c6-d859-45d7-ad07-5ab35279b032 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:35.643775 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-18b395c6-d859-45d7-ad07-5ab35279b032 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:35.644254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-18b395c6-d859-45d7-ad07-5ab35279b032 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:35.644713 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-18b395c6-d859-45d7-ad07-5ab35279b032 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:35.648566 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0bccaf57-01d2-4db1-8fe9-c8356a274a81 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:35.649041 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0bccaf57-01d2-4db1-8fe9-c8356a274a81 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:35.649480 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0bccaf57-01d2-4db1-8fe9-c8356a274a81 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:35.650151 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0bccaf57-01d2-4db1-8fe9-c8356a274a81 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:35.650594 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0bccaf57-01d2-4db1-8fe9-c8356a274a81 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:35.651006 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0bccaf57-01d2-4db1-8fe9-c8356a274a81 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:35.709295 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-18b395c6-d859-45d7-ad07-5ab35279b032 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:35.718837 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-18b395c6-d859-45d7-ad07-5ab35279b032 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1263 microversion: 2.1 time: 0.089155 Oct 24 13:28:35.720114 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 203/403] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:35 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1263 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:35.731450 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-0bccaf57-01d2-4db1-8fe9-c8356a274a81 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:35.736367 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-0bccaf57-01d2-4db1-8fe9-c8356a274a81 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1296 microversion: 2.1 time: 0.099590 Oct 24 13:28:35.737016 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 201/404] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:35 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:36.373722 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-07256deb-3280-4081-aa39-cba5b4f27f76 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:36.374330 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-07256deb-3280-4081-aa39-cba5b4f27f76 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:36.380545 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-07256deb-3280-4081-aa39-cba5b4f27f76 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:36.381208 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-07256deb-3280-4081-aa39-cba5b4f27f76 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:36.381794 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-07256deb-3280-4081-aa39-cba5b4f27f76 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:36.382772 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-07256deb-3280-4081-aa39-cba5b4f27f76 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:36.383534 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-07256deb-3280-4081-aa39-cba5b4f27f76 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:36.384207 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-07256deb-3280-4081-aa39-cba5b4f27f76 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:36.548448 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-07256deb-3280-4081-aa39-cba5b4f27f76 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:36.557154 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-07256deb-3280-4081-aa39-cba5b4f27f76 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.187514 Oct 24 13:28:36.558109 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 204/405] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:36 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:36.754477 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5cfb3692-ba98-4bc6-917f-d11f703fe262 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:36.755263 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5cfb3692-ba98-4bc6-917f-d11f703fe262 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:36.762058 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5cfb3692-ba98-4bc6-917f-d11f703fe262 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:36.762855 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5cfb3692-ba98-4bc6-917f-d11f703fe262 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:36.763499 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5cfb3692-ba98-4bc6-917f-d11f703fe262 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:36.764458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-34c6ce25-49d5-43c2-8a5f-0d380399d2a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:36.765004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5cfb3692-ba98-4bc6-917f-d11f703fe262 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:36.765110 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5cfb3692-ba98-4bc6-917f-d11f703fe262 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:36.765206 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-34c6ce25-49d5-43c2-8a5f-0d380399d2a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:36.765702 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5cfb3692-ba98-4bc6-917f-d11f703fe262 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:36.771791 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34c6ce25-49d5-43c2-8a5f-0d380399d2a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:36.773129 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34c6ce25-49d5-43c2-8a5f-0d380399d2a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:36.773783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34c6ce25-49d5-43c2-8a5f-0d380399d2a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:36.774830 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34c6ce25-49d5-43c2-8a5f-0d380399d2a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:36.775314 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34c6ce25-49d5-43c2-8a5f-0d380399d2a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:36.775849 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34c6ce25-49d5-43c2-8a5f-0d380399d2a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:36.852001 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-34c6ce25-49d5-43c2-8a5f-0d380399d2a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:36.853606 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5cfb3692-ba98-4bc6-917f-d11f703fe262 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:36.861669 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-34c6ce25-49d5-43c2-8a5f-0d380399d2a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1296 microversion: 2.1 time: 0.101794 Oct 24 13:28:36.863255 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 205/406] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:36 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1296 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:36.870283 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5cfb3692-ba98-4bc6-917f-d11f703fe262 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1255 microversion: 2.1 time: 0.120248 Oct 24 13:28:36.880825 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 202/407] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:36 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1255 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:37.580845 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-1945764b-22dd-4f7e-9ad1-8e78c734b26b tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:37.581453 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-1945764b-22dd-4f7e-9ad1-8e78c734b26b tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:37.587535 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1945764b-22dd-4f7e-9ad1-8e78c734b26b tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:37.588015 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1945764b-22dd-4f7e-9ad1-8e78c734b26b tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:37.588472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1945764b-22dd-4f7e-9ad1-8e78c734b26b tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:37.589157 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1945764b-22dd-4f7e-9ad1-8e78c734b26b tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:37.589606 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1945764b-22dd-4f7e-9ad1-8e78c734b26b tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:37.590024 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1945764b-22dd-4f7e-9ad1-8e78c734b26b tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:37.768722 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1945764b-22dd-4f7e-9ad1-8e78c734b26b tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:37.770914 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=100 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:37.776941 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-1945764b-22dd-4f7e-9ad1-8e78c734b26b tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.200449 Oct 24 13:28:37.777515 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 206/408] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:37 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:37.898314 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-6583fbce-bc0f-4558-a909-f9ee8ca5d7b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:37.898314 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-6583fbce-bc0f-4558-a909-f9ee8ca5d7b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:37.901450 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-cb421ecf-7621-4f5c-b741-e177382002d5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:37.905508 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-cb421ecf-7621-4f5c-b741-e177382002d5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:37.906686 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6583fbce-bc0f-4558-a909-f9ee8ca5d7b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:37.907384 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6583fbce-bc0f-4558-a909-f9ee8ca5d7b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:37.907976 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6583fbce-bc0f-4558-a909-f9ee8ca5d7b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:37.909038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6583fbce-bc0f-4558-a909-f9ee8ca5d7b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:37.909498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6583fbce-bc0f-4558-a909-f9ee8ca5d7b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:37.910667 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6583fbce-bc0f-4558-a909-f9ee8ca5d7b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:37.921692 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cb421ecf-7621-4f5c-b741-e177382002d5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:37.923720 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cb421ecf-7621-4f5c-b741-e177382002d5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:37.924898 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cb421ecf-7621-4f5c-b741-e177382002d5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:37.927882 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cb421ecf-7621-4f5c-b741-e177382002d5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:37.928501 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cb421ecf-7621-4f5c-b741-e177382002d5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:37.929040 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cb421ecf-7621-4f5c-b741-e177382002d5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:38.027137 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6583fbce-bc0f-4558-a909-f9ee8ca5d7b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:38.043860 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-6583fbce-bc0f-4558-a909-f9ee8ca5d7b9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1302 microversion: 2.1 time: 0.150193 Oct 24 13:28:38.044495 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 203/409] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:37 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1302 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:38.049699 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-23dd6c07-b957-40c8-bb24-eecaa76a3e54 req-9dbe0d4b-6d5e-42af-a934-d1db2a549c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "767060a8-d6d0-40fc-a72e-2c0a900e2217", "name": "network-vif-plugged", "status": "completed", "tag": "8d669271-6843-457a-b839-d4d358023ded"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:28:38.063219 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-cb421ecf-7621-4f5c-b741-e177382002d5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:38.065732 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-23dd6c07-b957-40c8-bb24-eecaa76a3e54 req-9dbe0d4b-6d5e-42af-a934-d1db2a549c57 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:38.066332 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-23dd6c07-b957-40c8-bb24-eecaa76a3e54 req-9dbe0d4b-6d5e-42af-a934-d1db2a549c57 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:38.067023 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-23dd6c07-b957-40c8-bb24-eecaa76a3e54 req-9dbe0d4b-6d5e-42af-a934-d1db2a549c57 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:38.073337 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-cb421ecf-7621-4f5c-b741-e177382002d5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1319 microversion: 2.1 time: 0.177153 Oct 24 13:28:38.074233 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 207/410] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:37 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:38.099514 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-23dd6c07-b957-40c8-bb24-eecaa76a3e54 req-9dbe0d4b-6d5e-42af-a934-d1db2a549c57 service nova] Creating event network-vif-plugged:8d669271-6843-457a-b839-d4d358023ded for instance 767060a8-d6d0-40fc-a72e-2c0a900e2217 on hv-cinder-86249 Oct 24 13:28:38.106720 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-23dd6c07-b957-40c8-bb24-eecaa76a3e54 req-9dbe0d4b-6d5e-42af-a934-d1db2a549c57 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060829 Oct 24 13:28:38.107480 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 204/411] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:28:38.801753 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b6722599-74d4-4643-8826-c6f95b3d4eef tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:38.806875 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b6722599-74d4-4643-8826-c6f95b3d4eef tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:38.814573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6722599-74d4-4643-8826-c6f95b3d4eef tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:38.815347 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6722599-74d4-4643-8826-c6f95b3d4eef tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:38.816130 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6722599-74d4-4643-8826-c6f95b3d4eef tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:38.817057 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6722599-74d4-4643-8826-c6f95b3d4eef tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:38.817694 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6722599-74d4-4643-8826-c6f95b3d4eef tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:38.818344 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6722599-74d4-4643-8826-c6f95b3d4eef tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:38.825948 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=2 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:39.074301 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7f6cb8c5-3f6e-4814-a5dd-e287b5d03e85 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:39.075641 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7f6cb8c5-3f6e-4814-a5dd-e287b5d03e85 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:39.089166 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b6722599-74d4-4643-8826-c6f95b3d4eef tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:39.099864 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7f6cb8c5-3f6e-4814-a5dd-e287b5d03e85 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:39.101198 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7f6cb8c5-3f6e-4814-a5dd-e287b5d03e85 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:39.104135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7f6cb8c5-3f6e-4814-a5dd-e287b5d03e85 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:39.104135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7f6cb8c5-3f6e-4814-a5dd-e287b5d03e85 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:39.104135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7f6cb8c5-3f6e-4814-a5dd-e287b5d03e85 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:39.104135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7f6cb8c5-3f6e-4814-a5dd-e287b5d03e85 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:39.105468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b6722599-74d4-4643-8826-c6f95b3d4eef tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.307803 Oct 24 13:28:39.106068 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 208/412] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:38 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:39.113175 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ed148fc2-4ec2-4d5b-8ded-f897347c640a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:39.114023 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ed148fc2-4ec2-4d5b-8ded-f897347c640a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:39.118452 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=22 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:39.131671 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ed148fc2-4ec2-4d5b-8ded-f897347c640a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:39.132429 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ed148fc2-4ec2-4d5b-8ded-f897347c640a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:39.138782 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ed148fc2-4ec2-4d5b-8ded-f897347c640a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:39.138782 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ed148fc2-4ec2-4d5b-8ded-f897347c640a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:39.138782 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ed148fc2-4ec2-4d5b-8ded-f897347c640a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:39.138782 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ed148fc2-4ec2-4d5b-8ded-f897347c640a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:39.360687 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7f6cb8c5-3f6e-4814-a5dd-e287b5d03e85 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:39.389130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7f6cb8c5-3f6e-4814-a5dd-e287b5d03e85 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.314102 Oct 24 13:28:39.410402 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 205/413] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:39 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:39.522231 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ed148fc2-4ec2-4d5b-8ded-f897347c640a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:39.531618 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ed148fc2-4ec2-4d5b-8ded-f897347c640a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.424442 Oct 24 13:28:39.536149 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 209/414] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:39 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:40.133365 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f56bd4ff-5dd6-406b-8df4-d81f780adefb tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:40.134041 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f56bd4ff-5dd6-406b-8df4-d81f780adefb tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:40.140985 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f56bd4ff-5dd6-406b-8df4-d81f780adefb tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:40.141465 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f56bd4ff-5dd6-406b-8df4-d81f780adefb tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:40.141891 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f56bd4ff-5dd6-406b-8df4-d81f780adefb tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:40.142574 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f56bd4ff-5dd6-406b-8df4-d81f780adefb tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:40.143016 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f56bd4ff-5dd6-406b-8df4-d81f780adefb tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:40.143429 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f56bd4ff-5dd6-406b-8df4-d81f780adefb tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:40.193790 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=14 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:40.282152 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f56bd4ff-5dd6-406b-8df4-d81f780adefb tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:40.289880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f56bd4ff-5dd6-406b-8df4-d81f780adefb tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.161182 Oct 24 13:28:40.292389 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 206/415] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:40 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:40.417288 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-efda4478-01e8-4186-b458-c799da4c1c98 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:40.418692 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-efda4478-01e8-4186-b458-c799da4c1c98 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:40.427414 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-efda4478-01e8-4186-b458-c799da4c1c98 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:40.427891 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-efda4478-01e8-4186-b458-c799da4c1c98 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:40.428363 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-efda4478-01e8-4186-b458-c799da4c1c98 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:40.429056 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-efda4478-01e8-4186-b458-c799da4c1c98 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:40.429499 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-efda4478-01e8-4186-b458-c799da4c1c98 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:40.429908 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-efda4478-01e8-4186-b458-c799da4c1c98 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:40.558114 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1fd38af9-ebc1-4b95-9c25-af6701f43874 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:40.559016 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-1fd38af9-ebc1-4b95-9c25-af6701f43874 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:40.567062 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1fd38af9-ebc1-4b95-9c25-af6701f43874 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:40.567558 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1fd38af9-ebc1-4b95-9c25-af6701f43874 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:40.568593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1fd38af9-ebc1-4b95-9c25-af6701f43874 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:40.569304 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1fd38af9-ebc1-4b95-9c25-af6701f43874 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:40.569760 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1fd38af9-ebc1-4b95-9c25-af6701f43874 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:40.570182 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1fd38af9-ebc1-4b95-9c25-af6701f43874 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:40.582935 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-efda4478-01e8-4186-b458-c799da4c1c98 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:40.590626 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-efda4478-01e8-4186-b458-c799da4c1c98 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.178940 Oct 24 13:28:40.591279 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 210/416] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:40 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:40.704960 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1fd38af9-ebc1-4b95-9c25-af6701f43874 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:40.712633 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1fd38af9-ebc1-4b95-9c25-af6701f43874 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.159312 Oct 24 13:28:40.713196 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 207/417] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:40 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:41.313913 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9fcebb51-79e8-43e3-bc17-4ea05d5c489d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:41.314454 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9fcebb51-79e8-43e3-bc17-4ea05d5c489d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:41.320791 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9fcebb51-79e8-43e3-bc17-4ea05d5c489d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:41.321267 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9fcebb51-79e8-43e3-bc17-4ea05d5c489d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:41.321694 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9fcebb51-79e8-43e3-bc17-4ea05d5c489d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:41.322382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9fcebb51-79e8-43e3-bc17-4ea05d5c489d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:41.322827 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9fcebb51-79e8-43e3-bc17-4ea05d5c489d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:41.323241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9fcebb51-79e8-43e3-bc17-4ea05d5c489d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:41.462617 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9fcebb51-79e8-43e3-bc17-4ea05d5c489d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:41.470809 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9fcebb51-79e8-43e3-bc17-4ea05d5c489d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.161167 Oct 24 13:28:41.471372 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 211/418] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:41 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:41.614018 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-29a23e99-bf48-4433-b65d-db99d26798f4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:41.614534 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-29a23e99-bf48-4433-b65d-db99d26798f4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:41.620914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-29a23e99-bf48-4433-b65d-db99d26798f4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:41.621379 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-29a23e99-bf48-4433-b65d-db99d26798f4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:41.621800 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-29a23e99-bf48-4433-b65d-db99d26798f4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:41.622470 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-29a23e99-bf48-4433-b65d-db99d26798f4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:41.622908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-29a23e99-bf48-4433-b65d-db99d26798f4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:41.623321 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-29a23e99-bf48-4433-b65d-db99d26798f4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:41.738296 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9ab17edf-8320-4f86-bf8d-4ddfbdd659bd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:41.739032 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9ab17edf-8320-4f86-bf8d-4ddfbdd659bd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:41.745068 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ab17edf-8320-4f86-bf8d-4ddfbdd659bd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:41.745607 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ab17edf-8320-4f86-bf8d-4ddfbdd659bd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:41.746098 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ab17edf-8320-4f86-bf8d-4ddfbdd659bd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:41.746836 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ab17edf-8320-4f86-bf8d-4ddfbdd659bd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:41.747345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ab17edf-8320-4f86-bf8d-4ddfbdd659bd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:41.747822 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ab17edf-8320-4f86-bf8d-4ddfbdd659bd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:41.759416 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-29a23e99-bf48-4433-b65d-db99d26798f4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:41.767604 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-29a23e99-bf48-4433-b65d-db99d26798f4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.157680 Oct 24 13:28:41.768161 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 208/419] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:41 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:41.871788 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9ab17edf-8320-4f86-bf8d-4ddfbdd659bd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:41.879734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9ab17edf-8320-4f86-bf8d-4ddfbdd659bd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.145325 Oct 24 13:28:41.880335 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 212/420] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:41 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:42.493852 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-73947c3f-6c70-4deb-a392-c518c62ac791 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:42.494801 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-73947c3f-6c70-4deb-a392-c518c62ac791 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:42.501246 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-73947c3f-6c70-4deb-a392-c518c62ac791 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:42.502039 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-73947c3f-6c70-4deb-a392-c518c62ac791 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:42.502670 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-73947c3f-6c70-4deb-a392-c518c62ac791 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:42.503586 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-73947c3f-6c70-4deb-a392-c518c62ac791 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:42.504233 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-73947c3f-6c70-4deb-a392-c518c62ac791 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:42.504665 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-73947c3f-6c70-4deb-a392-c518c62ac791 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:42.643231 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-73947c3f-6c70-4deb-a392-c518c62ac791 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:42.651016 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-73947c3f-6c70-4deb-a392-c518c62ac791 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.161072 Oct 24 13:28:42.651581 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 209/421] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:42 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:42.790405 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-152525ff-0721-42f2-9594-df4774d389a8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:42.790997 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-152525ff-0721-42f2-9594-df4774d389a8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:42.797026 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-152525ff-0721-42f2-9594-df4774d389a8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:42.797506 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-152525ff-0721-42f2-9594-df4774d389a8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:42.797930 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-152525ff-0721-42f2-9594-df4774d389a8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:42.798610 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-152525ff-0721-42f2-9594-df4774d389a8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:42.799054 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-152525ff-0721-42f2-9594-df4774d389a8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:42.799465 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-152525ff-0721-42f2-9594-df4774d389a8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:42.904110 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-4eb34363-3944-4a37-a24e-1f99ecc413f4 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:42.905474 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-4eb34363-3944-4a37-a24e-1f99ecc413f4 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:42.911655 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4eb34363-3944-4a37-a24e-1f99ecc413f4 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:42.912518 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4eb34363-3944-4a37-a24e-1f99ecc413f4 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:42.913029 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4eb34363-3944-4a37-a24e-1f99ecc413f4 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:42.913906 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4eb34363-3944-4a37-a24e-1f99ecc413f4 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:42.914281 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4eb34363-3944-4a37-a24e-1f99ecc413f4 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:42.914762 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4eb34363-3944-4a37-a24e-1f99ecc413f4 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:42.944091 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-152525ff-0721-42f2-9594-df4774d389a8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:42.952586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-152525ff-0721-42f2-9594-df4774d389a8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.165344 Oct 24 13:28:42.953169 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 213/422] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:42 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:43.066734 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-4eb34363-3944-4a37-a24e-1f99ecc413f4 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:43.084562 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-4eb34363-3944-4a37-a24e-1f99ecc413f4 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.184953 Oct 24 13:28:43.085627 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 210/423] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:42 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:43.675161 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-4fe80cc4-98d1-4b5f-9aae-9acb8e70e07e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:43.675764 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-4fe80cc4-98d1-4b5f-9aae-9acb8e70e07e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:43.681666 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4fe80cc4-98d1-4b5f-9aae-9acb8e70e07e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:43.682139 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4fe80cc4-98d1-4b5f-9aae-9acb8e70e07e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:43.682562 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4fe80cc4-98d1-4b5f-9aae-9acb8e70e07e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:43.683232 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4fe80cc4-98d1-4b5f-9aae-9acb8e70e07e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:43.683677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4fe80cc4-98d1-4b5f-9aae-9acb8e70e07e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:43.684089 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4fe80cc4-98d1-4b5f-9aae-9acb8e70e07e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:43.807974 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-4fe80cc4-98d1-4b5f-9aae-9acb8e70e07e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:43.815643 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-4fe80cc4-98d1-4b5f-9aae-9acb8e70e07e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.144836 Oct 24 13:28:43.816203 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 214/424] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:43 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:43.977797 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9ab1abed-53fc-4423-a252-e909beb202d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:43.978335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-9ab1abed-53fc-4423-a252-e909beb202d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:43.985397 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9ab1abed-53fc-4423-a252-e909beb202d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:43.985866 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9ab1abed-53fc-4423-a252-e909beb202d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:43.986290 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9ab1abed-53fc-4423-a252-e909beb202d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:43.986968 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9ab1abed-53fc-4423-a252-e909beb202d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:43.987419 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9ab1abed-53fc-4423-a252-e909beb202d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:43.987841 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9ab1abed-53fc-4423-a252-e909beb202d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:43.990374 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=100 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:44.107847 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b84213cc-c16b-4e64-bec3-a8acc1741174 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:44.109102 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b84213cc-c16b-4e64-bec3-a8acc1741174 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:44.115576 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b84213cc-c16b-4e64-bec3-a8acc1741174 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:44.116475 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b84213cc-c16b-4e64-bec3-a8acc1741174 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:44.116882 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b84213cc-c16b-4e64-bec3-a8acc1741174 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:44.117586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b84213cc-c16b-4e64-bec3-a8acc1741174 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:44.118033 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b84213cc-c16b-4e64-bec3-a8acc1741174 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:44.118452 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b84213cc-c16b-4e64-bec3-a8acc1741174 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:44.123859 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-9ab1abed-53fc-4423-a252-e909beb202d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:44.131848 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9ab1abed-53fc-4423-a252-e909beb202d5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.157851 Oct 24 13:28:44.132452 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 211/425] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:43 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:44.269294 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b84213cc-c16b-4e64-bec3-a8acc1741174 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:44.279663 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b84213cc-c16b-4e64-bec3-a8acc1741174 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.175777 Oct 24 13:28:44.281284 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 215/426] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:44 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:44.838640 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-4e901a81-ec26-4854-91ba-57a308b62186 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:44.839351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-4e901a81-ec26-4854-91ba-57a308b62186 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:44.845973 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4e901a81-ec26-4854-91ba-57a308b62186 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:44.846516 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4e901a81-ec26-4854-91ba-57a308b62186 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:44.847131 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4e901a81-ec26-4854-91ba-57a308b62186 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:44.847601 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4e901a81-ec26-4854-91ba-57a308b62186 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:44.848087 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4e901a81-ec26-4854-91ba-57a308b62186 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:44.848925 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4e901a81-ec26-4854-91ba-57a308b62186 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:44.998325 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-4e901a81-ec26-4854-91ba-57a308b62186 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:45.006754 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-4e901a81-ec26-4854-91ba-57a308b62186 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.171492 Oct 24 13:28:45.007763 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 212/427] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:44 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:45.155722 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-3a628713-3c0e-4b39-bebf-bd2011117446 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:45.156536 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-3a628713-3c0e-4b39-bebf-bd2011117446 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:45.163626 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3a628713-3c0e-4b39-bebf-bd2011117446 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:45.164105 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3a628713-3c0e-4b39-bebf-bd2011117446 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:45.164776 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3a628713-3c0e-4b39-bebf-bd2011117446 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:45.165539 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3a628713-3c0e-4b39-bebf-bd2011117446 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:45.165995 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3a628713-3c0e-4b39-bebf-bd2011117446 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:45.166422 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3a628713-3c0e-4b39-bebf-bd2011117446 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:45.303075 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-19396ea1-7974-43ac-9f1b-859ba427f380 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:45.303698 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-19396ea1-7974-43ac-9f1b-859ba427f380 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:45.309660 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-19396ea1-7974-43ac-9f1b-859ba427f380 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:45.310142 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-19396ea1-7974-43ac-9f1b-859ba427f380 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:45.310576 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-19396ea1-7974-43ac-9f1b-859ba427f380 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:45.311324 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-19396ea1-7974-43ac-9f1b-859ba427f380 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:45.311773 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-19396ea1-7974-43ac-9f1b-859ba427f380 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:45.312196 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-19396ea1-7974-43ac-9f1b-859ba427f380 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:45.315986 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-3a628713-3c0e-4b39-bebf-bd2011117446 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:45.323665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-3a628713-3c0e-4b39-bebf-bd2011117446 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.172588 Oct 24 13:28:45.325755 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 216/428] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:45 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:45.444157 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-19396ea1-7974-43ac-9f1b-859ba427f380 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:45.453109 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-19396ea1-7974-43ac-9f1b-859ba427f380 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.153964 Oct 24 13:28:45.453675 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 213/429] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:45 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:46.030972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ad6fd755-81ca-47a2-92dc-0dce3ffc235f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:46.031685 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ad6fd755-81ca-47a2-92dc-0dce3ffc235f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:46.038761 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ad6fd755-81ca-47a2-92dc-0dce3ffc235f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:46.039336 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ad6fd755-81ca-47a2-92dc-0dce3ffc235f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:46.039905 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ad6fd755-81ca-47a2-92dc-0dce3ffc235f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:46.040788 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ad6fd755-81ca-47a2-92dc-0dce3ffc235f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:46.041384 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ad6fd755-81ca-47a2-92dc-0dce3ffc235f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:46.041935 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ad6fd755-81ca-47a2-92dc-0dce3ffc235f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:46.180169 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ad6fd755-81ca-47a2-92dc-0dce3ffc235f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:46.189130 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ad6fd755-81ca-47a2-92dc-0dce3ffc235f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.162381 Oct 24 13:28:46.190086 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 217/430] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:46 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:46.354844 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9742c39e-6827-46c4-b938-b486c2b37ba5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:46.355558 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-9742c39e-6827-46c4-b938-b486c2b37ba5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:46.364545 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9742c39e-6827-46c4-b938-b486c2b37ba5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:46.365113 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9742c39e-6827-46c4-b938-b486c2b37ba5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:46.365632 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9742c39e-6827-46c4-b938-b486c2b37ba5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:46.366513 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9742c39e-6827-46c4-b938-b486c2b37ba5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:46.366967 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9742c39e-6827-46c4-b938-b486c2b37ba5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:46.367384 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9742c39e-6827-46c4-b938-b486c2b37ba5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:46.477220 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-1ffbb11b-e273-4b17-9d8f-d8450b9eebab tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:46.477828 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-1ffbb11b-e273-4b17-9d8f-d8450b9eebab tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:46.484004 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ffbb11b-e273-4b17-9d8f-d8450b9eebab tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:46.484702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ffbb11b-e273-4b17-9d8f-d8450b9eebab tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:46.485262 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ffbb11b-e273-4b17-9d8f-d8450b9eebab tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:46.486090 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ffbb11b-e273-4b17-9d8f-d8450b9eebab tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:46.486538 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ffbb11b-e273-4b17-9d8f-d8450b9eebab tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:46.486949 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ffbb11b-e273-4b17-9d8f-d8450b9eebab tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:46.526478 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-9742c39e-6827-46c4-b938-b486c2b37ba5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:46.534990 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9742c39e-6827-46c4-b938-b486c2b37ba5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.185136 Oct 24 13:28:46.546592 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 214/431] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:46 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:46.634044 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1ffbb11b-e273-4b17-9d8f-d8450b9eebab tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:46.642285 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-1ffbb11b-e273-4b17-9d8f-d8450b9eebab tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.168914 Oct 24 13:28:46.642840 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 218/432] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:46 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:47.214067 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9f479f15-44a6-44a0-ae39-5e2a8df6e93c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:47.214658 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-9f479f15-44a6-44a0-ae39-5e2a8df6e93c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:47.220621 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f479f15-44a6-44a0-ae39-5e2a8df6e93c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:47.221093 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f479f15-44a6-44a0-ae39-5e2a8df6e93c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:47.221512 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f479f15-44a6-44a0-ae39-5e2a8df6e93c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:47.222184 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f479f15-44a6-44a0-ae39-5e2a8df6e93c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:47.222625 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f479f15-44a6-44a0-ae39-5e2a8df6e93c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:47.223033 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f479f15-44a6-44a0-ae39-5e2a8df6e93c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:47.353344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-9f479f15-44a6-44a0-ae39-5e2a8df6e93c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:47.362044 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9f479f15-44a6-44a0-ae39-5e2a8df6e93c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.151772 Oct 24 13:28:47.362690 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 215/433] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:47 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:47.558820 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-3fd24f56-b543-44ec-9d20-c5678e91cba8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:47.559420 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-3fd24f56-b543-44ec-9d20-c5678e91cba8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:47.565413 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3fd24f56-b543-44ec-9d20-c5678e91cba8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:47.565886 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3fd24f56-b543-44ec-9d20-c5678e91cba8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:47.566311 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3fd24f56-b543-44ec-9d20-c5678e91cba8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:47.566981 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3fd24f56-b543-44ec-9d20-c5678e91cba8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:47.567425 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3fd24f56-b543-44ec-9d20-c5678e91cba8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:47.567838 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3fd24f56-b543-44ec-9d20-c5678e91cba8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:47.665651 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-021dbaec-7aee-46fb-99d1-8c35ce0cf151 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:47.666372 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-021dbaec-7aee-46fb-99d1-8c35ce0cf151 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:47.672978 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-021dbaec-7aee-46fb-99d1-8c35ce0cf151 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:47.673457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-021dbaec-7aee-46fb-99d1-8c35ce0cf151 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:47.673886 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-021dbaec-7aee-46fb-99d1-8c35ce0cf151 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:47.674804 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-021dbaec-7aee-46fb-99d1-8c35ce0cf151 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:47.675016 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-021dbaec-7aee-46fb-99d1-8c35ce0cf151 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:47.675455 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-021dbaec-7aee-46fb-99d1-8c35ce0cf151 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:47.694008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-3fd24f56-b543-44ec-9d20-c5678e91cba8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:47.701716 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-3fd24f56-b543-44ec-9d20-c5678e91cba8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.146654 Oct 24 13:28:47.702552 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 219/434] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:47 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:47.802419 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-021dbaec-7aee-46fb-99d1-8c35ce0cf151 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:47.809903 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-021dbaec-7aee-46fb-99d1-8c35ce0cf151 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.148179 Oct 24 13:28:47.810461 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 216/435] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:47 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:48.385554 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-447c228f-5fe7-42be-b3c2-a63a53c989f2 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:48.386076 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-447c228f-5fe7-42be-b3c2-a63a53c989f2 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:48.393004 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-447c228f-5fe7-42be-b3c2-a63a53c989f2 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:48.393471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-447c228f-5fe7-42be-b3c2-a63a53c989f2 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:48.393889 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-447c228f-5fe7-42be-b3c2-a63a53c989f2 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:48.394555 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-447c228f-5fe7-42be-b3c2-a63a53c989f2 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:48.394993 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-447c228f-5fe7-42be-b3c2-a63a53c989f2 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:48.395400 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-447c228f-5fe7-42be-b3c2-a63a53c989f2 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:48.531198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-447c228f-5fe7-42be-b3c2-a63a53c989f2 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:48.539147 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-447c228f-5fe7-42be-b3c2-a63a53c989f2 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.157367 Oct 24 13:28:48.539906 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 220/436] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:48 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:48.724852 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-18c3930c-464f-4c97-8545-521e1dcf6065 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:48.726309 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-18c3930c-464f-4c97-8545-521e1dcf6065 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:48.735665 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-18c3930c-464f-4c97-8545-521e1dcf6065 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:48.736509 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-18c3930c-464f-4c97-8545-521e1dcf6065 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:48.737208 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-18c3930c-464f-4c97-8545-521e1dcf6065 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:48.738582 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-18c3930c-464f-4c97-8545-521e1dcf6065 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:48.739287 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-18c3930c-464f-4c97-8545-521e1dcf6065 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:48.739899 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-18c3930c-464f-4c97-8545-521e1dcf6065 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:48.836920 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7b88ef07-8209-406d-bf85-64305448db85 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:48.837598 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-7b88ef07-8209-406d-bf85-64305448db85 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:48.847439 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7b88ef07-8209-406d-bf85-64305448db85 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:48.847945 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7b88ef07-8209-406d-bf85-64305448db85 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:48.850806 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7b88ef07-8209-406d-bf85-64305448db85 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:48.851769 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7b88ef07-8209-406d-bf85-64305448db85 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:48.852301 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7b88ef07-8209-406d-bf85-64305448db85 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:48.852726 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7b88ef07-8209-406d-bf85-64305448db85 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:48.898368 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-18c3930c-464f-4c97-8545-521e1dcf6065 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:48.906447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-18c3930c-464f-4c97-8545-521e1dcf6065 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.185804 Oct 24 13:28:48.907215 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 217/437] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:48 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:48.994972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-7b88ef07-8209-406d-bf85-64305448db85 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:49.008477 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-7b88ef07-8209-406d-bf85-64305448db85 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.170463 Oct 24 13:28:49.008477 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 221/438] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:48 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:49.562670 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-82c9cf45-6c79-4cfb-8f47-56748c6d2914 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:49.563355 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-82c9cf45-6c79-4cfb-8f47-56748c6d2914 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:49.569399 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-82c9cf45-6c79-4cfb-8f47-56748c6d2914 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:49.569873 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-82c9cf45-6c79-4cfb-8f47-56748c6d2914 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:49.570300 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-82c9cf45-6c79-4cfb-8f47-56748c6d2914 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:49.570990 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-82c9cf45-6c79-4cfb-8f47-56748c6d2914 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:49.571471 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-82c9cf45-6c79-4cfb-8f47-56748c6d2914 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:49.571910 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-82c9cf45-6c79-4cfb-8f47-56748c6d2914 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:49.698447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-82c9cf45-6c79-4cfb-8f47-56748c6d2914 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:49.706536 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-82c9cf45-6c79-4cfb-8f47-56748c6d2914 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.147980 Oct 24 13:28:49.707100 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 218/439] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:49 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:49.929737 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f5da0140-d6e3-483c-bee9-d6e4941267ab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:49.930341 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f5da0140-d6e3-483c-bee9-d6e4941267ab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:49.932294 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:49.937494 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f5da0140-d6e3-483c-bee9-d6e4941267ab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:49.937963 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f5da0140-d6e3-483c-bee9-d6e4941267ab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:49.949828 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f5da0140-d6e3-483c-bee9-d6e4941267ab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:49.949828 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f5da0140-d6e3-483c-bee9-d6e4941267ab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:49.949828 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f5da0140-d6e3-483c-bee9-d6e4941267ab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:49.949828 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f5da0140-d6e3-483c-bee9-d6e4941267ab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:50.026927 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-50a13645-00f1-480e-9c61-eaf0970b961e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:50.027535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-50a13645-00f1-480e-9c61-eaf0970b961e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:50.034136 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-50a13645-00f1-480e-9c61-eaf0970b961e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:50.034619 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-50a13645-00f1-480e-9c61-eaf0970b961e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:50.035046 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-50a13645-00f1-480e-9c61-eaf0970b961e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:50.035776 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-50a13645-00f1-480e-9c61-eaf0970b961e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:50.036236 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-50a13645-00f1-480e-9c61-eaf0970b961e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:50.036664 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-50a13645-00f1-480e-9c61-eaf0970b961e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:50.073258 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f5da0140-d6e3-483c-bee9-d6e4941267ab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:50.082284 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f5da0140-d6e3-483c-bee9-d6e4941267ab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.156360 Oct 24 13:28:50.082842 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 222/440] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:49 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:50.186619 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-50a13645-00f1-480e-9c61-eaf0970b961e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:50.194257 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-50a13645-00f1-480e-9c61-eaf0970b961e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.171228 Oct 24 13:28:50.194821 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 219/441] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:50 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:50.731345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-80a84ad5-30c9-4d8c-af54-9424b030b37c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:50.731883 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-80a84ad5-30c9-4d8c-af54-9424b030b37c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:50.739064 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-80a84ad5-30c9-4d8c-af54-9424b030b37c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:50.739542 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-80a84ad5-30c9-4d8c-af54-9424b030b37c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:50.739958 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-80a84ad5-30c9-4d8c-af54-9424b030b37c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:50.740856 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-80a84ad5-30c9-4d8c-af54-9424b030b37c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:50.741301 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-80a84ad5-30c9-4d8c-af54-9424b030b37c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:50.741715 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-80a84ad5-30c9-4d8c-af54-9424b030b37c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:50.758849 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=100 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:50.877357 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-80a84ad5-30c9-4d8c-af54-9424b030b37c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:50.885507 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-80a84ad5-30c9-4d8c-af54-9424b030b37c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.158041 Oct 24 13:28:50.886078 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 223/442] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:50 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:51.108095 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f3487210-a3fe-495b-8b05-27a677d48e28 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:51.109396 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f3487210-a3fe-495b-8b05-27a677d48e28 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:51.117095 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f3487210-a3fe-495b-8b05-27a677d48e28 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:51.124390 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f3487210-a3fe-495b-8b05-27a677d48e28 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:51.124390 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f3487210-a3fe-495b-8b05-27a677d48e28 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:51.124390 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f3487210-a3fe-495b-8b05-27a677d48e28 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:51.124390 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f3487210-a3fe-495b-8b05-27a677d48e28 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:51.124815 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f3487210-a3fe-495b-8b05-27a677d48e28 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:51.218163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-397e1d3c-453c-42ea-aea3-67e2e173b29d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:51.218761 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-397e1d3c-453c-42ea-aea3-67e2e173b29d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:51.225189 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-397e1d3c-453c-42ea-aea3-67e2e173b29d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:51.227653 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-397e1d3c-453c-42ea-aea3-67e2e173b29d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:51.227653 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-397e1d3c-453c-42ea-aea3-67e2e173b29d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:51.227653 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-397e1d3c-453c-42ea-aea3-67e2e173b29d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:51.227653 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-397e1d3c-453c-42ea-aea3-67e2e173b29d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:51.228395 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-397e1d3c-453c-42ea-aea3-67e2e173b29d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:51.255340 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f3487210-a3fe-495b-8b05-27a677d48e28 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:51.263523 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f3487210-a3fe-495b-8b05-27a677d48e28 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.159250 Oct 24 13:28:51.265192 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 220/443] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:51 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:51.366301 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-397e1d3c-453c-42ea-aea3-67e2e173b29d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:51.374432 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-397e1d3c-453c-42ea-aea3-67e2e173b29d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.160975 Oct 24 13:28:51.374982 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 224/444] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:51 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:51.908788 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8c1e4f65-07f6-4a9e-8781-0893bce08a3c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:51.909403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8c1e4f65-07f6-4a9e-8781-0893bce08a3c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:51.915544 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c1e4f65-07f6-4a9e-8781-0893bce08a3c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:51.916034 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c1e4f65-07f6-4a9e-8781-0893bce08a3c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:51.916763 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c1e4f65-07f6-4a9e-8781-0893bce08a3c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:51.917243 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c1e4f65-07f6-4a9e-8781-0893bce08a3c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:51.917690 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c1e4f65-07f6-4a9e-8781-0893bce08a3c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:51.918110 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c1e4f65-07f6-4a9e-8781-0893bce08a3c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:52.083375 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8c1e4f65-07f6-4a9e-8781-0893bce08a3c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:52.091265 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8c1e4f65-07f6-4a9e-8781-0893bce08a3c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.186378 Oct 24 13:28:52.091833 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 221/445] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:51 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:52.288308 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-51698b29-9300-472a-b9e2-42e77be18fed tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:52.288909 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-51698b29-9300-472a-b9e2-42e77be18fed tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:52.294921 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-51698b29-9300-472a-b9e2-42e77be18fed tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:52.296000 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-51698b29-9300-472a-b9e2-42e77be18fed tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:52.296449 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-51698b29-9300-472a-b9e2-42e77be18fed tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:52.299588 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-51698b29-9300-472a-b9e2-42e77be18fed tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:52.299588 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-51698b29-9300-472a-b9e2-42e77be18fed tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:52.299588 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-51698b29-9300-472a-b9e2-42e77be18fed tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:52.396969 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c038f30a-3e3c-49f5-8a85-46682f9e5f08 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:52.397561 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c038f30a-3e3c-49f5-8a85-46682f9e5f08 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:52.399816 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:52.404487 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c038f30a-3e3c-49f5-8a85-46682f9e5f08 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:52.405509 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c038f30a-3e3c-49f5-8a85-46682f9e5f08 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:52.405937 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c038f30a-3e3c-49f5-8a85-46682f9e5f08 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:52.406616 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c038f30a-3e3c-49f5-8a85-46682f9e5f08 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:52.407060 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c038f30a-3e3c-49f5-8a85-46682f9e5f08 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:52.407475 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c038f30a-3e3c-49f5-8a85-46682f9e5f08 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:52.436956 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-51698b29-9300-472a-b9e2-42e77be18fed tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:52.444980 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-51698b29-9300-472a-b9e2-42e77be18fed tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.160824 Oct 24 13:28:52.445751 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 225/446] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:52 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:52.555451 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c038f30a-3e3c-49f5-8a85-46682f9e5f08 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:52.563281 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c038f30a-3e3c-49f5-8a85-46682f9e5f08 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.170110 Oct 24 13:28:52.563845 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 222/447] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:52 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:53.119477 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-5045721e-d4e3-436f-8c6f-46c3cbae587e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:53.120113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-5045721e-d4e3-436f-8c6f-46c3cbae587e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:53.126576 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5045721e-d4e3-436f-8c6f-46c3cbae587e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:53.127051 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5045721e-d4e3-436f-8c6f-46c3cbae587e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:53.127478 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5045721e-d4e3-436f-8c6f-46c3cbae587e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:53.128151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5045721e-d4e3-436f-8c6f-46c3cbae587e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:53.128657 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5045721e-d4e3-436f-8c6f-46c3cbae587e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:53.129158 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5045721e-d4e3-436f-8c6f-46c3cbae587e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:53.268039 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-5045721e-d4e3-436f-8c6f-46c3cbae587e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:53.276653 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-5045721e-d4e3-436f-8c6f-46c3cbae587e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.160893 Oct 24 13:28:53.277286 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 226/448] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:53 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:53.468188 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-456fe8be-c4b7-4392-b8e4-e11336348d7f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:53.468909 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-456fe8be-c4b7-4392-b8e4-e11336348d7f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:53.474982 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-456fe8be-c4b7-4392-b8e4-e11336348d7f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:53.475462 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-456fe8be-c4b7-4392-b8e4-e11336348d7f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:53.475893 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-456fe8be-c4b7-4392-b8e4-e11336348d7f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:53.476610 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-456fe8be-c4b7-4392-b8e4-e11336348d7f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:53.477062 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-456fe8be-c4b7-4392-b8e4-e11336348d7f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:53.477484 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-456fe8be-c4b7-4392-b8e4-e11336348d7f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:53.586937 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-fd598d71-b1a8-4b05-bd33-3b945316effd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:53.587572 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-fd598d71-b1a8-4b05-bd33-3b945316effd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:53.594645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fd598d71-b1a8-4b05-bd33-3b945316effd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:53.595117 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fd598d71-b1a8-4b05-bd33-3b945316effd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:53.595551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fd598d71-b1a8-4b05-bd33-3b945316effd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:53.596244 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fd598d71-b1a8-4b05-bd33-3b945316effd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:53.596715 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fd598d71-b1a8-4b05-bd33-3b945316effd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:53.597181 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fd598d71-b1a8-4b05-bd33-3b945316effd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:53.618951 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-456fe8be-c4b7-4392-b8e4-e11336348d7f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:53.627411 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-456fe8be-c4b7-4392-b8e4-e11336348d7f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.163107 Oct 24 13:28:53.628092 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 223/449] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:53 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:53.737282 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-fd598d71-b1a8-4b05-bd33-3b945316effd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:53.746478 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-fd598d71-b1a8-4b05-bd33-3b945316effd tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.163334 Oct 24 13:28:53.747274 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 227/450] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:53 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:54.298797 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5111c79c-65b5-498d-af00-ba281d85eae7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:54.299337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5111c79c-65b5-498d-af00-ba281d85eae7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:54.306009 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5111c79c-65b5-498d-af00-ba281d85eae7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:54.306481 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5111c79c-65b5-498d-af00-ba281d85eae7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:54.306903 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5111c79c-65b5-498d-af00-ba281d85eae7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:54.307577 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5111c79c-65b5-498d-af00-ba281d85eae7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:54.308042 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5111c79c-65b5-498d-af00-ba281d85eae7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:54.308486 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5111c79c-65b5-498d-af00-ba281d85eae7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:54.438453 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5111c79c-65b5-498d-af00-ba281d85eae7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:54.446056 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5111c79c-65b5-498d-af00-ba281d85eae7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.151096 Oct 24 13:28:54.446692 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 224/451] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:54 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:54.654797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6a9adb14-457c-42ee-a750-4fa97c35d6b4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:54.655417 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-6a9adb14-457c-42ee-a750-4fa97c35d6b4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:54.661600 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6a9adb14-457c-42ee-a750-4fa97c35d6b4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:54.662089 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6a9adb14-457c-42ee-a750-4fa97c35d6b4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:54.662493 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6a9adb14-457c-42ee-a750-4fa97c35d6b4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:54.663168 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6a9adb14-457c-42ee-a750-4fa97c35d6b4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:54.663668 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6a9adb14-457c-42ee-a750-4fa97c35d6b4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:54.664119 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6a9adb14-457c-42ee-a750-4fa97c35d6b4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:54.769983 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1c341825-61f6-442c-8c44-784e28870398 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:54.771527 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-1c341825-61f6-442c-8c44-784e28870398 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:54.778544 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c341825-61f6-442c-8c44-784e28870398 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:54.779299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c341825-61f6-442c-8c44-784e28870398 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:54.779956 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c341825-61f6-442c-8c44-784e28870398 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:54.780898 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c341825-61f6-442c-8c44-784e28870398 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:54.781379 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c341825-61f6-442c-8c44-784e28870398 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:54.781797 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c341825-61f6-442c-8c44-784e28870398 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:54.799437 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-6a9adb14-457c-42ee-a750-4fa97c35d6b4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:54.806728 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6a9adb14-457c-42ee-a750-4fa97c35d6b4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.155673 Oct 24 13:28:54.807291 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 228/452] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:54 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:54.961663 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1c341825-61f6-442c-8c44-784e28870398 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:54.969754 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1c341825-61f6-442c-8c44-784e28870398 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.203801 Oct 24 13:28:54.970328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 225/453] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:54 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:55.471333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-496ee12a-6378-47d1-b6b9-4babbdf0e2cc tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:55.471946 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-496ee12a-6378-47d1-b6b9-4babbdf0e2cc tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:55.478348 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-496ee12a-6378-47d1-b6b9-4babbdf0e2cc tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:55.478832 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-496ee12a-6378-47d1-b6b9-4babbdf0e2cc tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:55.479256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-496ee12a-6378-47d1-b6b9-4babbdf0e2cc tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:55.479947 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-496ee12a-6378-47d1-b6b9-4babbdf0e2cc tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:55.480424 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-496ee12a-6378-47d1-b6b9-4babbdf0e2cc tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:55.480838 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-496ee12a-6378-47d1-b6b9-4babbdf0e2cc tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:55.632368 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-496ee12a-6378-47d1-b6b9-4babbdf0e2cc tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:55.640748 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-496ee12a-6378-47d1-b6b9-4babbdf0e2cc tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.175090 Oct 24 13:28:55.641318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 229/454] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:55 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:55.830586 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-0bc42c2a-c77c-4c2e-b580-ec334639dc07 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:55.831178 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-0bc42c2a-c77c-4c2e-b580-ec334639dc07 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:55.837552 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0bc42c2a-c77c-4c2e-b580-ec334639dc07 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:55.838148 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0bc42c2a-c77c-4c2e-b580-ec334639dc07 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:55.838444 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0bc42c2a-c77c-4c2e-b580-ec334639dc07 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:55.839121 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0bc42c2a-c77c-4c2e-b580-ec334639dc07 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:55.839567 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0bc42c2a-c77c-4c2e-b580-ec334639dc07 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:55.839983 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0bc42c2a-c77c-4c2e-b580-ec334639dc07 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:55.969712 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-0bc42c2a-c77c-4c2e-b580-ec334639dc07 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:55.974837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-0bc42c2a-c77c-4c2e-b580-ec334639dc07 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.148644 Oct 24 13:28:55.975736 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 226/455] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:55 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:55.994298 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-5754cfaf-7a09-497a-8606-aa45c2401cd1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:55.994910 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-5754cfaf-7a09-497a-8606-aa45c2401cd1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:56.001430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5754cfaf-7a09-497a-8606-aa45c2401cd1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:56.001904 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5754cfaf-7a09-497a-8606-aa45c2401cd1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:56.002328 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5754cfaf-7a09-497a-8606-aa45c2401cd1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:56.003007 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5754cfaf-7a09-497a-8606-aa45c2401cd1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:56.003456 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5754cfaf-7a09-497a-8606-aa45c2401cd1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:56.003873 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5754cfaf-7a09-497a-8606-aa45c2401cd1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:56.140312 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-5754cfaf-7a09-497a-8606-aa45c2401cd1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:56.148535 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-5754cfaf-7a09-497a-8606-aa45c2401cd1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.159147 Oct 24 13:28:56.149200 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 230/456] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:55 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:56.664421 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1d85b361-ead0-426b-9284-82adc78a3e2d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:56.664953 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-1d85b361-ead0-426b-9284-82adc78a3e2d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:56.671611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1d85b361-ead0-426b-9284-82adc78a3e2d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:56.672089 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1d85b361-ead0-426b-9284-82adc78a3e2d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:56.672541 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1d85b361-ead0-426b-9284-82adc78a3e2d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:56.673231 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1d85b361-ead0-426b-9284-82adc78a3e2d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:56.673685 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1d85b361-ead0-426b-9284-82adc78a3e2d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:56.674109 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1d85b361-ead0-426b-9284-82adc78a3e2d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:56.814571 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1d85b361-ead0-426b-9284-82adc78a3e2d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:56.816761 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=100 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:28:56.823176 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1d85b361-ead0-426b-9284-82adc78a3e2d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1314 microversion: 2.1 time: 0.162686 Oct 24 13:28:56.836684 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 227/457] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:56 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:56.998242 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9ccfc5a2-c790-4c3a-bd64-94616b3e90ac tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:56.999099 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9ccfc5a2-c790-4c3a-bd64-94616b3e90ac tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:57.005487 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ccfc5a2-c790-4c3a-bd64-94616b3e90ac tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:57.006150 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ccfc5a2-c790-4c3a-bd64-94616b3e90ac tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:57.006683 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ccfc5a2-c790-4c3a-bd64-94616b3e90ac tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:57.007435 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ccfc5a2-c790-4c3a-bd64-94616b3e90ac tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:57.007941 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ccfc5a2-c790-4c3a-bd64-94616b3e90ac tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:57.008410 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ccfc5a2-c790-4c3a-bd64-94616b3e90ac tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:57.172757 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b2e6db12-4c80-4961-8f32-1f5c78422812 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:57.173493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b2e6db12-4c80-4961-8f32-1f5c78422812 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:57.180814 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2e6db12-4c80-4961-8f32-1f5c78422812 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:57.183115 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2e6db12-4c80-4961-8f32-1f5c78422812 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:57.183115 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2e6db12-4c80-4961-8f32-1f5c78422812 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:57.183115 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2e6db12-4c80-4961-8f32-1f5c78422812 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:57.183444 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2e6db12-4c80-4961-8f32-1f5c78422812 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:57.183878 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2e6db12-4c80-4961-8f32-1f5c78422812 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:57.294490 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9ccfc5a2-c790-4c3a-bd64-94616b3e90ac tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:57.304308 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9ccfc5a2-c790-4c3a-bd64-94616b3e90ac tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.309981 Oct 24 13:28:57.304893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 231/458] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:56 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:57.323873 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b2e6db12-4c80-4961-8f32-1f5c78422812 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:57.340166 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b2e6db12-4c80-4961-8f32-1f5c78422812 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.172583 Oct 24 13:28:57.341037 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 228/459] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:57 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:57.846828 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7a2bfb96-0a5b-444f-aa1c-d4c8376d10fc tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:57.847465 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-7a2bfb96-0a5b-444f-aa1c-d4c8376d10fc tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:57.853257 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7a2bfb96-0a5b-444f-aa1c-d4c8376d10fc tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:57.855858 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7a2bfb96-0a5b-444f-aa1c-d4c8376d10fc tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:57.855858 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7a2bfb96-0a5b-444f-aa1c-d4c8376d10fc tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:57.855858 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7a2bfb96-0a5b-444f-aa1c-d4c8376d10fc tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:57.855858 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7a2bfb96-0a5b-444f-aa1c-d4c8376d10fc tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:57.856233 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7a2bfb96-0a5b-444f-aa1c-d4c8376d10fc tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:58.134308 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-7a2bfb96-0a5b-444f-aa1c-d4c8376d10fc tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:58.142497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-7a2bfb96-0a5b-444f-aa1c-d4c8376d10fc tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1498 microversion: 2.1 time: 0.299615 Oct 24 13:28:58.143294 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 232/460] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:57 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1498 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:58.327812 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b6759ca4-2ee9-42c6-986c-1c458135f337 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:58.328443 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b6759ca4-2ee9-42c6-986c-1c458135f337 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:58.334784 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b6759ca4-2ee9-42c6-986c-1c458135f337 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:58.335253 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b6759ca4-2ee9-42c6-986c-1c458135f337 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:58.335678 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b6759ca4-2ee9-42c6-986c-1c458135f337 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:58.336365 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b6759ca4-2ee9-42c6-986c-1c458135f337 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:58.336809 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b6759ca4-2ee9-42c6-986c-1c458135f337 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:58.337219 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b6759ca4-2ee9-42c6-986c-1c458135f337 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:58.364698 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-370c334a-f25d-4f96-8c63-a09b9765fa7f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:58.365890 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-370c334a-f25d-4f96-8c63-a09b9765fa7f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:58.372896 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-370c334a-f25d-4f96-8c63-a09b9765fa7f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:58.375565 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-370c334a-f25d-4f96-8c63-a09b9765fa7f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:58.375565 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-370c334a-f25d-4f96-8c63-a09b9765fa7f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:58.375565 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-370c334a-f25d-4f96-8c63-a09b9765fa7f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:58.376476 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-370c334a-f25d-4f96-8c63-a09b9765fa7f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:58.376970 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-370c334a-f25d-4f96-8c63-a09b9765fa7f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:58.479142 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b6759ca4-2ee9-42c6-986c-1c458135f337 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:58.487607 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b6759ca4-2ee9-42c6-986c-1c458135f337 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.163631 Oct 24 13:28:58.500470 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 229/461] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:58 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:58.510510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-ce5ad1ae-a554-40e9-9bad-5829e0b07a41 req-7b3a5f8f-9e93-4b3c-b685-2f1f0f813cbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb595949-cb79-47e4-b760-6e9dfd97b222", "tag": "c2e4dc49-a4c3-4b4e-97ea-3d9c9f960383"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:28:58.521494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-ce5ad1ae-a554-40e9-9bad-5829e0b07a41 req-7b3a5f8f-9e93-4b3c-b685-2f1f0f813cbe service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:58.521965 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-ce5ad1ae-a554-40e9-9bad-5829e0b07a41 req-7b3a5f8f-9e93-4b3c-b685-2f1f0f813cbe service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:58.522385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-ce5ad1ae-a554-40e9-9bad-5829e0b07a41 req-7b3a5f8f-9e93-4b3c-b685-2f1f0f813cbe service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:58.534482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-ce5ad1ae-a554-40e9-9bad-5829e0b07a41 req-7b3a5f8f-9e93-4b3c-b685-2f1f0f813cbe service nova] Creating event network-changed:c2e4dc49-a4c3-4b4e-97ea-3d9c9f960383 for instance bb595949-cb79-47e4-b760-6e9dfd97b222 on hv-cinder-86249 Oct 24 13:28:58.540025 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-ce5ad1ae-a554-40e9-9bad-5829e0b07a41 req-7b3a5f8f-9e93-4b3c-b685-2f1f0f813cbe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036596 Oct 24 13:28:58.541088 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 230/462] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:28:58.634397 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-370c334a-f25d-4f96-8c63-a09b9765fa7f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:58.638296 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-370c334a-f25d-4f96-8c63-a09b9765fa7f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.278126 Oct 24 13:28:58.639366 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 233/463] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:58 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:59.125893 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bfa015be-0f0a-4c7b-8f6c-f21465eabcbd tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:59.126784 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bfa015be-0f0a-4c7b-8f6c-f21465eabcbd tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:59.133127 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bfa015be-0f0a-4c7b-8f6c-f21465eabcbd tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:59.133716 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bfa015be-0f0a-4c7b-8f6c-f21465eabcbd tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:59.134143 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bfa015be-0f0a-4c7b-8f6c-f21465eabcbd tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:59.134818 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bfa015be-0f0a-4c7b-8f6c-f21465eabcbd tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:59.135439 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bfa015be-0f0a-4c7b-8f6c-f21465eabcbd tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:59.135854 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bfa015be-0f0a-4c7b-8f6c-f21465eabcbd tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:59.161614 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bfa015be-0f0a-4c7b-8f6c-f21465eabcbd tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Going to try to terminate instance {{(pid=119146) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:28:59.403304 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-bfa015be-0f0a-4c7b-8f6c-f21465eabcbd tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "DELETE /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 204 len: 0 microversion: 2.1 time: 0.281860 Oct 24 13:28:59.403943 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 231/464] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:28:59 2022] DELETE /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:28:59.411882 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c3c33362-aef6-4f60-a610-04209c2f61a6 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:59.412680 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-c3c33362-aef6-4f60-a610-04209c2f61a6 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:59.418682 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c3c33362-aef6-4f60-a610-04209c2f61a6 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:59.419147 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c3c33362-aef6-4f60-a610-04209c2f61a6 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:59.419567 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c3c33362-aef6-4f60-a610-04209c2f61a6 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:59.420814 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c3c33362-aef6-4f60-a610-04209c2f61a6 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:59.421250 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c3c33362-aef6-4f60-a610-04209c2f61a6 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:59.421655 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c3c33362-aef6-4f60-a610-04209c2f61a6 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:59.513762 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8c98be30-783d-41f1-b2ab-904401f5f7c0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:59.514710 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8c98be30-783d-41f1-b2ab-904401f5f7c0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:59.520724 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c98be30-783d-41f1-b2ab-904401f5f7c0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:59.521205 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c98be30-783d-41f1-b2ab-904401f5f7c0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:59.521634 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c98be30-783d-41f1-b2ab-904401f5f7c0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:59.522322 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c98be30-783d-41f1-b2ab-904401f5f7c0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:59.522777 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c98be30-783d-41f1-b2ab-904401f5f7c0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:59.523196 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c98be30-783d-41f1-b2ab-904401f5f7c0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:59.558902 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c3c33362-aef6-4f60-a610-04209c2f61a6 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:59.563489 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-c3c33362-aef6-4f60-a610-04209c2f61a6 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1504 microversion: 2.1 time: 0.155314 Oct 24 13:28:59.564252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 234/465] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:59 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:28:59.659501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8c98be30-783d-41f1-b2ab-904401f5f7c0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:59.662192 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c2d496af-18ec-4831-ae0f-cc7772f10f8d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:28:59.662876 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-c2d496af-18ec-4831-ae0f-cc7772f10f8d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:28:59.667649 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8c98be30-783d-41f1-b2ab-904401f5f7c0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.157970 Oct 24 13:28:59.668308 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 232/466] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:59 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:28:59.669073 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c2d496af-18ec-4831-ae0f-cc7772f10f8d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:59.669506 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c2d496af-18ec-4831-ae0f-cc7772f10f8d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:59.669977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c2d496af-18ec-4831-ae0f-cc7772f10f8d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:59.671171 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c2d496af-18ec-4831-ae0f-cc7772f10f8d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:28:59.671784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c2d496af-18ec-4831-ae0f-cc7772f10f8d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:28:59.672233 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c2d496af-18ec-4831-ae0f-cc7772f10f8d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:28:59.803221 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c2d496af-18ec-4831-ae0f-cc7772f10f8d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:28:59.811104 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-c2d496af-18ec-4831-ae0f-cc7772f10f8d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.153095 Oct 24 13:28:59.811667 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 235/467] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:28:59 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:00.559226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-cc3aa097-6c9b-40b2-b06c-a207bcda6182 req-87fd479c-1962-4990-9ab4-4380b1436aba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47783c4e-2d71-46f8-a964-e268979915ac", "tag": "600465f3-a863-40a8-8e98-8ea8cd65d5a3"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:29:00.569432 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-cc3aa097-6c9b-40b2-b06c-a207bcda6182 req-87fd479c-1962-4990-9ab4-4380b1436aba service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:00.569906 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-cc3aa097-6c9b-40b2-b06c-a207bcda6182 req-87fd479c-1962-4990-9ab4-4380b1436aba service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:00.570331 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-cc3aa097-6c9b-40b2-b06c-a207bcda6182 req-87fd479c-1962-4990-9ab4-4380b1436aba service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:00.581492 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-cc3aa097-6c9b-40b2-b06c-a207bcda6182 req-87fd479c-1962-4990-9ab4-4380b1436aba service nova] Creating event network-changed:600465f3-a863-40a8-8e98-8ea8cd65d5a3 for instance 47783c4e-2d71-46f8-a964-e268979915ac on hv-cinder-86249 Oct 24 13:29:00.586234 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-cc3aa097-6c9b-40b2-b06c-a207bcda6182 req-87fd479c-1962-4990-9ab4-4380b1436aba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030731 Oct 24 13:29:00.586808 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 233/468] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:29:00.586942 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b85f83be-a1bc-4582-b080-f1c9e1fbae58 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:00.587624 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b85f83be-a1bc-4582-b080-f1c9e1fbae58 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:00.593748 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b85f83be-a1bc-4582-b080-f1c9e1fbae58 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:00.594231 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b85f83be-a1bc-4582-b080-f1c9e1fbae58 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:00.594645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b85f83be-a1bc-4582-b080-f1c9e1fbae58 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:00.595320 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b85f83be-a1bc-4582-b080-f1c9e1fbae58 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:00.595763 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b85f83be-a1bc-4582-b080-f1c9e1fbae58 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:00.596194 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b85f83be-a1bc-4582-b080-f1c9e1fbae58 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:00.692206 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-efcc9005-4a3b-49c8-b9cc-f945fefa3134 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:00.692946 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-efcc9005-4a3b-49c8-b9cc-f945fefa3134 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:00.698988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-efcc9005-4a3b-49c8-b9cc-f945fefa3134 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:00.699530 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-efcc9005-4a3b-49c8-b9cc-f945fefa3134 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:00.699966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-efcc9005-4a3b-49c8-b9cc-f945fefa3134 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:00.700677 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-efcc9005-4a3b-49c8-b9cc-f945fefa3134 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:00.701128 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-efcc9005-4a3b-49c8-b9cc-f945fefa3134 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:00.702059 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-efcc9005-4a3b-49c8-b9cc-f945fefa3134 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:00.725364 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b85f83be-a1bc-4582-b080-f1c9e1fbae58 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:00.733947 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b85f83be-a1bc-4582-b080-f1c9e1fbae58 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1504 microversion: 2.1 time: 0.150807 Oct 24 13:29:00.735582 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 236/469] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:00 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:00.828488 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-efcc9005-4a3b-49c8-b9cc-f945fefa3134 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:00.834865 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8864b7aa-fe42-49e1-8c1c-10c71f41b406 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:00.835473 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-8864b7aa-fe42-49e1-8c1c-10c71f41b406 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:00.836170 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-efcc9005-4a3b-49c8-b9cc-f945fefa3134 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.148216 Oct 24 13:29:00.836798 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 234/470] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:00 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:00.841351 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8864b7aa-fe42-49e1-8c1c-10c71f41b406 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:00.841848 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8864b7aa-fe42-49e1-8c1c-10c71f41b406 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:00.842275 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8864b7aa-fe42-49e1-8c1c-10c71f41b406 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:00.842953 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8864b7aa-fe42-49e1-8c1c-10c71f41b406 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:00.843397 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8864b7aa-fe42-49e1-8c1c-10c71f41b406 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:00.843841 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8864b7aa-fe42-49e1-8c1c-10c71f41b406 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:00.966927 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-8864b7aa-fe42-49e1-8c1c-10c71f41b406 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:00.974461 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-8864b7aa-fe42-49e1-8c1c-10c71f41b406 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.143408 Oct 24 13:29:00.975023 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 237/471] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:00 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:01.758316 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b27a16a4-a852-4019-bf6d-8260b875470c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:01.759115 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b27a16a4-a852-4019-bf6d-8260b875470c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:01.766279 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b27a16a4-a852-4019-bf6d-8260b875470c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:01.766758 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b27a16a4-a852-4019-bf6d-8260b875470c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:01.767180 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b27a16a4-a852-4019-bf6d-8260b875470c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:01.767859 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b27a16a4-a852-4019-bf6d-8260b875470c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:01.768328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b27a16a4-a852-4019-bf6d-8260b875470c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:01.768745 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b27a16a4-a852-4019-bf6d-8260b875470c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:01.859118 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-682385b4-1821-452a-bc34-7cbbc203dabb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:01.859731 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-682385b4-1821-452a-bc34-7cbbc203dabb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:01.865841 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-682385b4-1821-452a-bc34-7cbbc203dabb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:01.866320 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-682385b4-1821-452a-bc34-7cbbc203dabb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:01.866747 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-682385b4-1821-452a-bc34-7cbbc203dabb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:01.867427 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-682385b4-1821-452a-bc34-7cbbc203dabb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:01.867958 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-682385b4-1821-452a-bc34-7cbbc203dabb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:01.868295 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-682385b4-1821-452a-bc34-7cbbc203dabb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:01.959617 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b27a16a4-a852-4019-bf6d-8260b875470c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:01.968832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b27a16a4-a852-4019-bf6d-8260b875470c tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1504 microversion: 2.1 time: 0.214313 Oct 24 13:29:01.969834 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 235/472] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:01 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:01.998610 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9426d842-d2d6-4381-9108-45f11ecce7ff tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:01.999214 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-9426d842-d2d6-4381-9108-45f11ecce7ff tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:01.999956 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-682385b4-1821-452a-bc34-7cbbc203dabb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:02.005403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9426d842-d2d6-4381-9108-45f11ecce7ff tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:02.005879 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9426d842-d2d6-4381-9108-45f11ecce7ff tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:02.006301 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9426d842-d2d6-4381-9108-45f11ecce7ff tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:02.006985 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9426d842-d2d6-4381-9108-45f11ecce7ff tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:02.007429 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9426d842-d2d6-4381-9108-45f11ecce7ff tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:02.007841 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9426d842-d2d6-4381-9108-45f11ecce7ff tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:02.009686 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-682385b4-1821-452a-bc34-7cbbc203dabb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.154536 Oct 24 13:29:02.010295 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 238/473] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:01 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:02.354350 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-9426d842-d2d6-4381-9108-45f11ecce7ff tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:02.363060 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9426d842-d2d6-4381-9108-45f11ecce7ff tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.368751 Oct 24 13:29:02.364084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 236/474] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:01 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:02.993026 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-03378c27-4c51-459d-9b64-7ac4450b246d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:02.993803 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-03378c27-4c51-459d-9b64-7ac4450b246d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:02.999702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-03378c27-4c51-459d-9b64-7ac4450b246d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:03.000205 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-03378c27-4c51-459d-9b64-7ac4450b246d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:03.000665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-03378c27-4c51-459d-9b64-7ac4450b246d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:03.001344 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-03378c27-4c51-459d-9b64-7ac4450b246d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:03.001790 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-03378c27-4c51-459d-9b64-7ac4450b246d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:03.002203 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-03378c27-4c51-459d-9b64-7ac4450b246d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:03.033070 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-00e128f3-607c-40c0-ab4a-a5f6bde155bf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:03.033678 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-00e128f3-607c-40c0-ab4a-a5f6bde155bf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:03.040740 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-00e128f3-607c-40c0-ab4a-a5f6bde155bf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:03.041426 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-00e128f3-607c-40c0-ab4a-a5f6bde155bf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:03.042021 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-00e128f3-607c-40c0-ab4a-a5f6bde155bf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:03.042890 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-00e128f3-607c-40c0-ab4a-a5f6bde155bf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:03.043504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-00e128f3-607c-40c0-ab4a-a5f6bde155bf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:03.043919 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-00e128f3-607c-40c0-ab4a-a5f6bde155bf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:03.142191 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-03378c27-4c51-459d-9b64-7ac4450b246d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:03.150410 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-03378c27-4c51-459d-9b64-7ac4450b246d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1504 microversion: 2.1 time: 0.161178 Oct 24 13:29:03.150979 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 239/475] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:02 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:03.198547 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-00e128f3-607c-40c0-ab4a-a5f6bde155bf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:03.206903 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-00e128f3-607c-40c0-ab4a-a5f6bde155bf tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.178221 Oct 24 13:29:03.207467 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 237/476] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:03 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:03.387482 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-24d6c4ad-6bf1-44fa-a4bd-37a028f19062 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:03.387482 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-24d6c4ad-6bf1-44fa-a4bd-37a028f19062 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:03.394023 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-24d6c4ad-6bf1-44fa-a4bd-37a028f19062 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:03.394502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-24d6c4ad-6bf1-44fa-a4bd-37a028f19062 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:03.394935 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-24d6c4ad-6bf1-44fa-a4bd-37a028f19062 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:03.395611 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-24d6c4ad-6bf1-44fa-a4bd-37a028f19062 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:03.396055 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-24d6c4ad-6bf1-44fa-a4bd-37a028f19062 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:03.396501 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-24d6c4ad-6bf1-44fa-a4bd-37a028f19062 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:03.400623 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=100 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:03.526836 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-24d6c4ad-6bf1-44fa-a4bd-37a028f19062 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:03.534470 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-24d6c4ad-6bf1-44fa-a4bd-37a028f19062 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.151692 Oct 24 13:29:03.535025 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 240/477] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:03 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:04.175196 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-2176eda0-87eb-416a-987e-964ec88f5dab tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:04.175831 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-2176eda0-87eb-416a-987e-964ec88f5dab tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:04.182299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2176eda0-87eb-416a-987e-964ec88f5dab tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:04.182774 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2176eda0-87eb-416a-987e-964ec88f5dab tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:04.183198 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2176eda0-87eb-416a-987e-964ec88f5dab tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:04.184056 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2176eda0-87eb-416a-987e-964ec88f5dab tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:04.184541 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2176eda0-87eb-416a-987e-964ec88f5dab tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:04.187690 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2176eda0-87eb-416a-987e-964ec88f5dab tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:04.229974 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8b87a1bb-7bd5-42db-90ac-47b30d2a10f5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:04.231397 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-8b87a1bb-7bd5-42db-90ac-47b30d2a10f5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:04.239095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8b87a1bb-7bd5-42db-90ac-47b30d2a10f5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:04.239576 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8b87a1bb-7bd5-42db-90ac-47b30d2a10f5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:04.240033 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8b87a1bb-7bd5-42db-90ac-47b30d2a10f5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:04.240802 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8b87a1bb-7bd5-42db-90ac-47b30d2a10f5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:04.241417 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8b87a1bb-7bd5-42db-90ac-47b30d2a10f5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:04.241978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8b87a1bb-7bd5-42db-90ac-47b30d2a10f5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:04.333592 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-2176eda0-87eb-416a-987e-964ec88f5dab tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:04.343173 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-2176eda0-87eb-416a-987e-964ec88f5dab tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1504 microversion: 2.1 time: 0.171925 Oct 24 13:29:04.344668 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 238/478] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:04 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:04.389014 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-8b87a1bb-7bd5-42db-90ac-47b30d2a10f5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:04.397296 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-8b87a1bb-7bd5-42db-90ac-47b30d2a10f5 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.171492 Oct 24 13:29:04.397906 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 241/479] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:04 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:04.557248 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1f0cecd2-a5de-45d2-9d5e-ae33a0f68cc3 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:04.558207 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-1f0cecd2-a5de-45d2-9d5e-ae33a0f68cc3 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:04.564653 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1f0cecd2-a5de-45d2-9d5e-ae33a0f68cc3 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:04.565146 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1f0cecd2-a5de-45d2-9d5e-ae33a0f68cc3 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:04.565577 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1f0cecd2-a5de-45d2-9d5e-ae33a0f68cc3 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:04.566269 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1f0cecd2-a5de-45d2-9d5e-ae33a0f68cc3 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:04.566901 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1f0cecd2-a5de-45d2-9d5e-ae33a0f68cc3 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:04.567512 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1f0cecd2-a5de-45d2-9d5e-ae33a0f68cc3 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:04.699987 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1f0cecd2-a5de-45d2-9d5e-ae33a0f68cc3 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:04.708519 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1f0cecd2-a5de-45d2-9d5e-ae33a0f68cc3 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.154983 Oct 24 13:29:04.709021 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 239/480] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:04 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:05.367138 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9a9753b2-82b9-4e7a-9573-163017ff5f56 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:05.367794 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9a9753b2-82b9-4e7a-9573-163017ff5f56 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:05.374317 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9a9753b2-82b9-4e7a-9573-163017ff5f56 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:05.374809 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9a9753b2-82b9-4e7a-9573-163017ff5f56 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:05.375226 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9a9753b2-82b9-4e7a-9573-163017ff5f56 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:05.375908 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9a9753b2-82b9-4e7a-9573-163017ff5f56 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:05.376383 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9a9753b2-82b9-4e7a-9573-163017ff5f56 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:05.376802 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9a9753b2-82b9-4e7a-9573-163017ff5f56 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:05.420757 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-6bdfcf1e-a8f5-4a2f-9417-b8aa48196b8d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:05.422067 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-6bdfcf1e-a8f5-4a2f-9417-b8aa48196b8d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:05.428567 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6bdfcf1e-a8f5-4a2f-9417-b8aa48196b8d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:05.429051 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6bdfcf1e-a8f5-4a2f-9417-b8aa48196b8d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:05.429526 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6bdfcf1e-a8f5-4a2f-9417-b8aa48196b8d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:05.430166 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6bdfcf1e-a8f5-4a2f-9417-b8aa48196b8d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:05.430616 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6bdfcf1e-a8f5-4a2f-9417-b8aa48196b8d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:05.431034 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6bdfcf1e-a8f5-4a2f-9417-b8aa48196b8d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:05.504586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9a9753b2-82b9-4e7a-9573-163017ff5f56 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:05.512761 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9a9753b2-82b9-4e7a-9573-163017ff5f56 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1504 microversion: 2.1 time: 0.149384 Oct 24 13:29:05.513811 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 242/481] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:05 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:05.564951 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6bdfcf1e-a8f5-4a2f-9417-b8aa48196b8d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:05.572487 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-6bdfcf1e-a8f5-4a2f-9417-b8aa48196b8d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.156232 Oct 24 13:29:05.573054 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 240/482] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:05 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:05.730834 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-1a5f657d-5cb5-4e70-9072-f0d72bba8f7f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:05.731459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-1a5f657d-5cb5-4e70-9072-f0d72bba8f7f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:05.737989 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1a5f657d-5cb5-4e70-9072-f0d72bba8f7f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:05.738453 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1a5f657d-5cb5-4e70-9072-f0d72bba8f7f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:05.738871 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1a5f657d-5cb5-4e70-9072-f0d72bba8f7f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:05.739537 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1a5f657d-5cb5-4e70-9072-f0d72bba8f7f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:05.739977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1a5f657d-5cb5-4e70-9072-f0d72bba8f7f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:05.740425 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1a5f657d-5cb5-4e70-9072-f0d72bba8f7f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:05.866966 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1a5f657d-5cb5-4e70-9072-f0d72bba8f7f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:05.875362 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-1a5f657d-5cb5-4e70-9072-f0d72bba8f7f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.148289 Oct 24 13:29:05.875956 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 243/483] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:05 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:06.014683 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-ab4469d6-737d-4267-9a07-531675f6aaf5 req-0268141f-53a1-4414-85db-502fc2154f19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47783c4e-2d71-46f8-a964-e268979915ac", "name": "network-vif-plugged", "status": "completed", "tag": "600465f3-a863-40a8-8e98-8ea8cd65d5a3"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:29:06.024192 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-ab4469d6-737d-4267-9a07-531675f6aaf5 req-0268141f-53a1-4414-85db-502fc2154f19 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:06.024701 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-ab4469d6-737d-4267-9a07-531675f6aaf5 req-0268141f-53a1-4414-85db-502fc2154f19 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:06.025127 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-ab4469d6-737d-4267-9a07-531675f6aaf5 req-0268141f-53a1-4414-85db-502fc2154f19 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:06.039529 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-ab4469d6-737d-4267-9a07-531675f6aaf5 req-0268141f-53a1-4414-85db-502fc2154f19 service nova] Creating event network-vif-plugged:600465f3-a863-40a8-8e98-8ea8cd65d5a3 for instance 47783c4e-2d71-46f8-a964-e268979915ac on hv-cinder-86249 Oct 24 13:29:06.044774 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-ab4469d6-737d-4267-9a07-531675f6aaf5 req-0268141f-53a1-4414-85db-502fc2154f19 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034288 Oct 24 13:29:06.045352 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 241/484] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:29:06.535545 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-260a5352-c13a-4926-ba3b-484d0a38b84f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:06.536145 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-260a5352-c13a-4926-ba3b-484d0a38b84f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:06.543422 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-260a5352-c13a-4926-ba3b-484d0a38b84f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:06.543894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-260a5352-c13a-4926-ba3b-484d0a38b84f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:06.544355 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-260a5352-c13a-4926-ba3b-484d0a38b84f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:06.545032 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-260a5352-c13a-4926-ba3b-484d0a38b84f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:06.545472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-260a5352-c13a-4926-ba3b-484d0a38b84f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:06.545925 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-260a5352-c13a-4926-ba3b-484d0a38b84f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:06.596678 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-216170e4-44a8-4607-81d3-636b4612e663 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:06.597401 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-216170e4-44a8-4607-81d3-636b4612e663 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:06.603726 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-216170e4-44a8-4607-81d3-636b4612e663 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:06.604199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-216170e4-44a8-4607-81d3-636b4612e663 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:06.604679 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-216170e4-44a8-4607-81d3-636b4612e663 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:06.605485 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-216170e4-44a8-4607-81d3-636b4612e663 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:06.605939 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-216170e4-44a8-4607-81d3-636b4612e663 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:06.606425 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-216170e4-44a8-4607-81d3-636b4612e663 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:06.746870 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-216170e4-44a8-4607-81d3-636b4612e663 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:06.754766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-216170e4-44a8-4607-81d3-636b4612e663 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.163348 Oct 24 13:29:06.755366 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 242/485] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:06 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:06.837448 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-260a5352-c13a-4926-ba3b-484d0a38b84f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:06.845807 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-260a5352-c13a-4926-ba3b-484d0a38b84f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1504 microversion: 2.1 time: 0.314209 Oct 24 13:29:06.846409 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 244/486] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:06 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1504 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:06.897918 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-45148803-03f3-443e-b1d4-5d9106d4906e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:06.898521 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-45148803-03f3-443e-b1d4-5d9106d4906e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:06.904660 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-45148803-03f3-443e-b1d4-5d9106d4906e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:06.905127 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-45148803-03f3-443e-b1d4-5d9106d4906e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:06.906166 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-45148803-03f3-443e-b1d4-5d9106d4906e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:06.906886 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-45148803-03f3-443e-b1d4-5d9106d4906e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:06.907329 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-45148803-03f3-443e-b1d4-5d9106d4906e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:06.907742 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-45148803-03f3-443e-b1d4-5d9106d4906e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:07.040593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-45148803-03f3-443e-b1d4-5d9106d4906e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:07.048395 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-45148803-03f3-443e-b1d4-5d9106d4906e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.154323 Oct 24 13:29:07.048968 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 243/487] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:06 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:07.335334 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-5aeac4ae-d780-4c1c-9d7c-65ecf6e0238a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-9956699", "imageRef": "1a874490-179e-412c-895e-52b16935c04c", "flavorRef": "452", "networks": [{"uuid": "ecd23e7e-0b9d-4b8b-a6ad-089c005916e2"}]}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:29:07.386745 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.network.neutron [None req-5aeac4ae-d780-4c1c-9d7c-65ecf6e0238a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] validate_networks() for [('ecd23e7e-0b9d-4b8b-a6ad-089c005916e2', None, None, None, None, None)] {{(pid=119145) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:29:07.778128 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-58513a3b-c10b-4b45-a3a5-7e987d791c75 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:07.778774 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-58513a3b-c10b-4b45-a3a5-7e987d791c75 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:07.785601 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-58513a3b-c10b-4b45-a3a5-7e987d791c75 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:07.786081 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-58513a3b-c10b-4b45-a3a5-7e987d791c75 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:07.786512 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-58513a3b-c10b-4b45-a3a5-7e987d791c75 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:07.787223 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-58513a3b-c10b-4b45-a3a5-7e987d791c75 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:07.787672 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-58513a3b-c10b-4b45-a3a5-7e987d791c75 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:07.788091 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-58513a3b-c10b-4b45-a3a5-7e987d791c75 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:07.816095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-5aeac4ae-d780-4c1c-9d7c-65ecf6e0238a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Flavor limits 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:29:07.816554 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-5aeac4ae-d780-4c1c-9d7c-65ecf6e0238a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Image limits 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:29:07.817124 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-5aeac4ae-d780-4c1c-9d7c-65ecf6e0238a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Flavor pref 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:29:07.817558 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-5aeac4ae-d780-4c1c-9d7c-65ecf6e0238a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Image pref 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:29:07.817989 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-5aeac4ae-d780-4c1c-9d7c-65ecf6e0238a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:29:07.826896 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5aeac4ae-d780-4c1c-9d7c-65ecf6e0238a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:07.827406 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5aeac4ae-d780-4c1c-9d7c-65ecf6e0238a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:07.828022 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5aeac4ae-d780-4c1c-9d7c-65ecf6e0238a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:07.828769 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5aeac4ae-d780-4c1c-9d7c-65ecf6e0238a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:07.829381 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5aeac4ae-d780-4c1c-9d7c-65ecf6e0238a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:07.829794 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5aeac4ae-d780-4c1c-9d7c-65ecf6e0238a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:07.847272 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-5aeac4ae-d780-4c1c-9d7c-65ecf6e0238a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Getting quotas for project ca3097281d4c43458b408414648233a0. Resources: {'ram', 'instances', 'cores'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:29:07.851174 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-5aeac4ae-d780-4c1c-9d7c-65ecf6e0238a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Getting quotas for user 315f9ad503b8402090faac7b827b5463 and project ca3097281d4c43458b408414648233a0. Resources: {'ram', 'instances', 'cores'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:29:07.863159 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-5aeac4ae-d780-4c1c-9d7c-65ecf6e0238a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Going to run 1 instances... {{(pid=119145) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:29:07.865762 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-5aeac4ae-d780-4c1c-9d7c-65ecf6e0238a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a874490-179e-412c-895e-52b16935c04c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119145) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:29:07.928219 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-58513a3b-c10b-4b45-a3a5-7e987d791c75 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:07.931399 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:07.937754 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-58513a3b-c10b-4b45-a3a5-7e987d791c75 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.163450 Oct 24 13:29:07.938335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 244/488] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:07 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:07.942747 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bb455366-1043-4559-837b-d67a7468d828 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:07.943352 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bb455366-1043-4559-837b-d67a7468d828 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:07.949277 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb455366-1043-4559-837b-d67a7468d828 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:07.949669 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb455366-1043-4559-837b-d67a7468d828 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:07.950089 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb455366-1043-4559-837b-d67a7468d828 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:07.950765 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb455366-1043-4559-837b-d67a7468d828 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:07.951204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb455366-1043-4559-837b-d67a7468d828 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:07.951876 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bb455366-1043-4559-837b-d67a7468d828 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:08.017661 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-5aeac4ae-d780-4c1c-9d7c-65ecf6e0238a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685845 Oct 24 13:29:08.018653 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 245/489] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 24 13:29:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:29:08.029741 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-4d80b9a0-6874-4d97-b685-1d33c581e449 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:08.030349 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-4d80b9a0-6874-4d97-b685-1d33c581e449 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:08.086065 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-4d80b9a0-6874-4d97-b685-1d33c581e449 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:08.093814 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-4d80b9a0-6874-4d97-b685-1d33c581e449 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1216 microversion: 2.1 time: 0.067225 Oct 24 13:29:08.094903 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 246/490] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:08 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1216 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:08.107492 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-76fcf9d2-f1e5-42e9-a59c-a92d6db49abc tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:08.108208 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-76fcf9d2-f1e5-42e9-a59c-a92d6db49abc tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:08.115977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76fcf9d2-f1e5-42e9-a59c-a92d6db49abc tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:08.116562 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76fcf9d2-f1e5-42e9-a59c-a92d6db49abc tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:08.116997 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76fcf9d2-f1e5-42e9-a59c-a92d6db49abc tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:08.117690 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76fcf9d2-f1e5-42e9-a59c-a92d6db49abc tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:08.118701 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76fcf9d2-f1e5-42e9-a59c-a92d6db49abc tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:08.119122 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76fcf9d2-f1e5-42e9-a59c-a92d6db49abc tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:08.129060 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-bb455366-1043-4559-837b-d67a7468d828 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:08.143533 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-bb455366-1043-4559-837b-d67a7468d828 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1504 microversion: 2.1 time: 0.204150 Oct 24 13:29:08.144119 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 245/491] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:07 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1504 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:08.711446 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-76fcf9d2-f1e5-42e9-a59c-a92d6db49abc tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:08.719590 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-76fcf9d2-f1e5-42e9-a59c-a92d6db49abc tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1359 microversion: 2.1 time: 0.623307 Oct 24 13:29:08.720545 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 247/492] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:08 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1359 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:08.963008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-25aeff25-587d-47b9-afc6-41c0c2202e5f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:08.963807 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-25aeff25-587d-47b9-afc6-41c0c2202e5f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:08.970426 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-25aeff25-587d-47b9-afc6-41c0c2202e5f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:08.970990 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-25aeff25-587d-47b9-afc6-41c0c2202e5f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:08.971513 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-25aeff25-587d-47b9-afc6-41c0c2202e5f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:08.972365 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-25aeff25-587d-47b9-afc6-41c0c2202e5f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:08.972888 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-25aeff25-587d-47b9-afc6-41c0c2202e5f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:08.973521 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-25aeff25-587d-47b9-afc6-41c0c2202e5f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:09.118253 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-775349f3-0089-4b2a-8fed-6b66ef52aac7 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:09.118860 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-775349f3-0089-4b2a-8fed-6b66ef52aac7 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:09.118970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-25aeff25-587d-47b9-afc6-41c0c2202e5f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:09.126282 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-775349f3-0089-4b2a-8fed-6b66ef52aac7 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:09.127003 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-775349f3-0089-4b2a-8fed-6b66ef52aac7 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:09.127598 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-775349f3-0089-4b2a-8fed-6b66ef52aac7 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:09.128517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-775349f3-0089-4b2a-8fed-6b66ef52aac7 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:09.128964 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-775349f3-0089-4b2a-8fed-6b66ef52aac7 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:09.129372 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-775349f3-0089-4b2a-8fed-6b66ef52aac7 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:09.129762 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-25aeff25-587d-47b9-afc6-41c0c2202e5f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.171029 Oct 24 13:29:09.146761 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 246/493] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:08 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:09.158218 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-881b50da-73ca-4fab-89dc-5b9d70ca980e req-0c754c4d-cd91-4ced-83b3-f1e987537f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "767060a8-d6d0-40fc-a72e-2c0a900e2217", "name": "network-vif-deleted", "tag": "8d669271-6843-457a-b839-d4d358023ded"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:29:09.167803 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-881b50da-73ca-4fab-89dc-5b9d70ca980e req-0c754c4d-cd91-4ced-83b3-f1e987537f42 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:09.168294 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-881b50da-73ca-4fab-89dc-5b9d70ca980e req-0c754c4d-cd91-4ced-83b3-f1e987537f42 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:09.168721 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-881b50da-73ca-4fab-89dc-5b9d70ca980e req-0c754c4d-cd91-4ced-83b3-f1e987537f42 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:09.180527 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-881b50da-73ca-4fab-89dc-5b9d70ca980e req-0c754c4d-cd91-4ced-83b3-f1e987537f42 service nova] Creating event network-vif-deleted:8d669271-6843-457a-b839-d4d358023ded for instance 767060a8-d6d0-40fc-a72e-2c0a900e2217 on hv-cinder-86249 Oct 24 13:29:09.185493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-881b50da-73ca-4fab-89dc-5b9d70ca980e req-0c754c4d-cd91-4ced-83b3-f1e987537f42 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030981 Oct 24 13:29:09.186078 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 247/494] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:29:09.191729 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-d6dbb724-5363-48f8-a637-ee0e02d385e7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:09.192455 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-d6dbb724-5363-48f8-a637-ee0e02d385e7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:09.195692 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-775349f3-0089-4b2a-8fed-6b66ef52aac7 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:09.198558 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d6dbb724-5363-48f8-a637-ee0e02d385e7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:09.199031 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d6dbb724-5363-48f8-a637-ee0e02d385e7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:09.199455 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d6dbb724-5363-48f8-a637-ee0e02d385e7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:09.200149 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d6dbb724-5363-48f8-a637-ee0e02d385e7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:09.200647 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d6dbb724-5363-48f8-a637-ee0e02d385e7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:09.201063 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d6dbb724-5363-48f8-a637-ee0e02d385e7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:09.206015 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-775349f3-0089-4b2a-8fed-6b66ef52aac7 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1220 microversion: 2.1 time: 0.092175 Oct 24 13:29:09.207164 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 248/495] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:09 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:09.271400 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-d6dbb724-5363-48f8-a637-ee0e02d385e7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:09.281574 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-d6dbb724-5363-48f8-a637-ee0e02d385e7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1462 microversion: 2.1 time: 0.092602 Oct 24 13:29:09.282170 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 248/496] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:09 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1462 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:09.742609 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-45d3fd38-e43e-4ced-b0df-ce0943bde635 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:09.743247 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-45d3fd38-e43e-4ced-b0df-ce0943bde635 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:09.752608 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-45d3fd38-e43e-4ced-b0df-ce0943bde635 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:09.752608 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-45d3fd38-e43e-4ced-b0df-ce0943bde635 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:09.752608 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-45d3fd38-e43e-4ced-b0df-ce0943bde635 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:09.752608 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-45d3fd38-e43e-4ced-b0df-ce0943bde635 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:09.752974 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-45d3fd38-e43e-4ced-b0df-ce0943bde635 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:09.752974 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-45d3fd38-e43e-4ced-b0df-ce0943bde635 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:09.881480 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-45d3fd38-e43e-4ced-b0df-ce0943bde635 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:09.889315 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-45d3fd38-e43e-4ced-b0df-ce0943bde635 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1549 microversion: 2.1 time: 0.150369 Oct 24 13:29:09.890560 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 249/497] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:09 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:09.913855 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-901c7602-abf2-4b8a-b672-b0020e488319 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:09.914500 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-901c7602-abf2-4b8a-b672-b0020e488319 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:09.920518 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-901c7602-abf2-4b8a-b672-b0020e488319 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:09.921029 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-901c7602-abf2-4b8a-b672-b0020e488319 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:09.921470 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-901c7602-abf2-4b8a-b672-b0020e488319 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:09.922167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-901c7602-abf2-4b8a-b672-b0020e488319 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:09.922819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-901c7602-abf2-4b8a-b672-b0020e488319 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:09.923176 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-901c7602-abf2-4b8a-b672-b0020e488319 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:10.054971 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-901c7602-abf2-4b8a-b672-b0020e488319 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:10.063420 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-901c7602-abf2-4b8a-b672-b0020e488319 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1549 microversion: 2.1 time: 0.153776 Oct 24 13:29:10.064314 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 249/498] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:09 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:10.086014 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-2ea5e1ef-9506-4b46-8662-4602d759d102 req-2c3a3d32-d385-4564-9d46-95ad91720d8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb595949-cb79-47e4-b760-6e9dfd97b222", "name": "network-vif-plugged", "status": "completed", "tag": "c2e4dc49-a4c3-4b4e-97ea-3d9c9f960383"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:29:10.096074 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-30ad4cda-ef2c-45da-a40e-0322cd0c8d39 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:10.097702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-2ea5e1ef-9506-4b46-8662-4602d759d102 req-2c3a3d32-d385-4564-9d46-95ad91720d8f service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:10.098351 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-2ea5e1ef-9506-4b46-8662-4602d759d102 req-2c3a3d32-d385-4564-9d46-95ad91720d8f service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:10.098770 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-2ea5e1ef-9506-4b46-8662-4602d759d102 req-2c3a3d32-d385-4564-9d46-95ad91720d8f service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:10.100963 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-30ad4cda-ef2c-45da-a40e-0322cd0c8d39 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:10.101934 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-30ad4cda-ef2c-45da-a40e-0322cd0c8d39 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Searching by: {'deleted': False, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9'} {{(pid=119146) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 13:29:10.109074 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-30ad4cda-ef2c-45da-a40e-0322cd0c8d39 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:10.113194 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-30ad4cda-ef2c-45da-a40e-0322cd0c8d39 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:10.113194 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-30ad4cda-ef2c-45da-a40e-0322cd0c8d39 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:10.113390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-2ea5e1ef-9506-4b46-8662-4602d759d102 req-2c3a3d32-d385-4564-9d46-95ad91720d8f service nova] Creating event network-vif-plugged:c2e4dc49-a4c3-4b4e-97ea-3d9c9f960383 for instance bb595949-cb79-47e4-b760-6e9dfd97b222 on hv-cinder-86249 Oct 24 13:29:10.113475 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-30ad4cda-ef2c-45da-a40e-0322cd0c8d39 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:10.113475 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-30ad4cda-ef2c-45da-a40e-0322cd0c8d39 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:10.113475 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-30ad4cda-ef2c-45da-a40e-0322cd0c8d39 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:10.115442 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-2ea5e1ef-9506-4b46-8662-4602d759d102 req-2c3a3d32-d385-4564-9d46-95ad91720d8f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033907 Oct 24 13:29:10.116099 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 250/499] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:29:10.153450 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-4ccab034-0556-4c92-b2e0-3b35a44233c7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:10.154301 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-4ccab034-0556-4c92-b2e0-3b35a44233c7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:10.161928 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4ccab034-0556-4c92-b2e0-3b35a44233c7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:10.162519 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4ccab034-0556-4c92-b2e0-3b35a44233c7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:10.163050 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4ccab034-0556-4c92-b2e0-3b35a44233c7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:10.163857 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4ccab034-0556-4c92-b2e0-3b35a44233c7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:10.164444 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4ccab034-0556-4c92-b2e0-3b35a44233c7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:10.164952 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4ccab034-0556-4c92-b2e0-3b35a44233c7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:10.203410 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.multi_cell_list [None req-30ad4cda-ef2c-45da-a40e-0322cd0c8d39 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119146) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 13:29:10.301124 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-30ad4cda-ef2c-45da-a40e-0322cd0c8d39 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.214205 Oct 24 13:29:10.301824 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 250/500] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Oct 24 13:29:10 2022] GET /compute/v2.1/servers => generated 343 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:29:10.306026 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-4ccab034-0556-4c92-b2e0-3b35a44233c7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:10.306654 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a597e13f-e72f-4f83-99b7-605d1036b193 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:10.307349 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a597e13f-e72f-4f83-99b7-605d1036b193 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:10.316636 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a597e13f-e72f-4f83-99b7-605d1036b193 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:10.317356 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a597e13f-e72f-4f83-99b7-605d1036b193 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:10.317780 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a597e13f-e72f-4f83-99b7-605d1036b193 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:10.318639 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a597e13f-e72f-4f83-99b7-605d1036b193 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:10.319243 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a597e13f-e72f-4f83-99b7-605d1036b193 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:10.319657 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a597e13f-e72f-4f83-99b7-605d1036b193 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:10.331936 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-4ccab034-0556-4c92-b2e0-3b35a44233c7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.182569 Oct 24 13:29:10.332563 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 251/501] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:10 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:10.337281 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8f2ff1b9-6546-4368-9e9e-8bb25b37007f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:10.338632 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-8f2ff1b9-6546-4368-9e9e-8bb25b37007f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:10.344848 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8f2ff1b9-6546-4368-9e9e-8bb25b37007f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:10.345328 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8f2ff1b9-6546-4368-9e9e-8bb25b37007f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:10.345758 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8f2ff1b9-6546-4368-9e9e-8bb25b37007f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:10.346442 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8f2ff1b9-6546-4368-9e9e-8bb25b37007f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:10.346889 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8f2ff1b9-6546-4368-9e9e-8bb25b37007f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:10.347307 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8f2ff1b9-6546-4368-9e9e-8bb25b37007f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:10.379626 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8f2ff1b9-6546-4368-9e9e-8bb25b37007f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:10.380100 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8f2ff1b9-6546-4368-9e9e-8bb25b37007f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:10.380577 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8f2ff1b9-6546-4368-9e9e-8bb25b37007f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:10.381018 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.objects.instance [None req-8f2ff1b9-6546-4368-9e9e-8bb25b37007f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lazy-loading 'fault' on Instance uuid 767060a8-d6d0-40fc-a72e-2c0a900e2217 {{(pid=119145) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:29:10.388099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a597e13f-e72f-4f83-99b7-605d1036b193 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:10.395840 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a597e13f-e72f-4f83-99b7-605d1036b193 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1212 microversion: 2.1 time: 0.092976 Oct 24 13:29:10.396435 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 251/502] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:10 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:10.400933 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-cb192a41-0efe-4957-8e41-9b5f59e5b49b tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:10.402930 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-cb192a41-0efe-4957-8e41-9b5f59e5b49b tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:10.407721 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb192a41-0efe-4957-8e41-9b5f59e5b49b tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:10.408201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb192a41-0efe-4957-8e41-9b5f59e5b49b tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:10.408666 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb192a41-0efe-4957-8e41-9b5f59e5b49b tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:10.409353 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb192a41-0efe-4957-8e41-9b5f59e5b49b tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:10.409801 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb192a41-0efe-4957-8e41-9b5f59e5b49b tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:10.410217 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb192a41-0efe-4957-8e41-9b5f59e5b49b tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:10.427586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-8f2ff1b9-6546-4368-9e9e-8bb25b37007f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:10.436109 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-8f2ff1b9-6546-4368-9e9e-8bb25b37007f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 200 len: 1304 microversion: 2.1 time: 0.102532 Oct 24 13:29:10.444784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 252/503] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:10 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:10.555514 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-cb192a41-0efe-4957-8e41-9b5f59e5b49b tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:10.573627 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-cb192a41-0efe-4957-8e41-9b5f59e5b49b tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1549 microversion: 2.1 time: 0.176152 Oct 24 13:29:10.574211 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 252/504] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:10 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1549 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:11.355211 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-98c4cae0-801e-4351-ace4-b0acf326c02d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:11.355896 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-98c4cae0-801e-4351-ace4-b0acf326c02d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:11.362105 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-98c4cae0-801e-4351-ace4-b0acf326c02d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:11.362659 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-98c4cae0-801e-4351-ace4-b0acf326c02d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:11.363159 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-98c4cae0-801e-4351-ace4-b0acf326c02d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:11.363910 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-98c4cae0-801e-4351-ace4-b0acf326c02d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:11.364485 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-98c4cae0-801e-4351-ace4-b0acf326c02d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:11.365003 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-98c4cae0-801e-4351-ace4-b0acf326c02d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:11.418844 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b0635671-2ab9-4b01-81a2-5f78927abc30 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:11.419455 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b0635671-2ab9-4b01-81a2-5f78927abc30 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:11.425909 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b0635671-2ab9-4b01-81a2-5f78927abc30 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:11.426397 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b0635671-2ab9-4b01-81a2-5f78927abc30 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:11.426831 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b0635671-2ab9-4b01-81a2-5f78927abc30 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:11.427521 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b0635671-2ab9-4b01-81a2-5f78927abc30 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:11.427969 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b0635671-2ab9-4b01-81a2-5f78927abc30 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:11.428441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b0635671-2ab9-4b01-81a2-5f78927abc30 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:11.494862 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-98c4cae0-801e-4351-ace4-b0acf326c02d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:11.495023 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b0635671-2ab9-4b01-81a2-5f78927abc30 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:11.503242 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-98c4cae0-801e-4351-ace4-b0acf326c02d tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.152107 Oct 24 13:29:11.503466 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b0635671-2ab9-4b01-81a2-5f78927abc30 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1268 microversion: 2.1 time: 0.088321 Oct 24 13:29:11.504043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 253/506] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:11 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1268 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:11.504180 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 253/506] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:11 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:11.512933 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-2091b355-aa29-410c-a7b5-77b63404591e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:11.513529 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-2091b355-aa29-410c-a7b5-77b63404591e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 767060a8-d6d0-40fc-a72e-2c0a900e2217] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:11.519851 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2091b355-aa29-410c-a7b5-77b63404591e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:11.520363 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2091b355-aa29-410c-a7b5-77b63404591e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:11.520923 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2091b355-aa29-410c-a7b5-77b63404591e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:11.521616 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2091b355-aa29-410c-a7b5-77b63404591e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:11.522060 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2091b355-aa29-410c-a7b5-77b63404591e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:11.522472 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2091b355-aa29-410c-a7b5-77b63404591e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:11.535195 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-2091b355-aa29-410c-a7b5-77b63404591e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] HTTP exception thrown: Instance 767060a8-d6d0-40fc-a72e-2c0a900e2217 could not be found. Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-2091b355-aa29-410c-a7b5-77b63404591e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Request method failure captured: Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 HTTP/1.1 Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpLsY2LzNAyLeeFfV4suMlswFGKuKZV1g1Ey7-g8PFw2jYcog8k0-mL5LmWbxbkUHsL3UuFZhe9gYSyNURl8FW8ip2tjunqrHf2jAkYeVkh38QVozt_zFswllitgOClRgGhJL2OGtjwPUSEncAFPyaBO4mJKIWecUCllkkCYNaO1ajw Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 10316acf2adf4f34a63a08f0e60b2548 Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-VolumesActionsTest-1088026127 Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:29:11.537948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:29:11.539493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_10316acf2adf4f34a63a08f0e60b2548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/10316acf2adf4f34a63a08f0e60b2548"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/10316acf2adf4f34a63a08f0e60b2548"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/10316acf2adf4f34a63a08f0e60b2548"}]}] Oct 24 13:29:11.539493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-VolumesActionsTest-1088026127 Oct 24 13:29:11.539493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 10316acf2adf4f34a63a08f0e60b2548 Oct 24 13:29:11.539493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-VolumesActionsTest-1088026127 Oct 24 13:29:11.539493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-VolumesActionsTest-1088026127-project Oct 24 13:29:11.539493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:29:11.539493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:29:11.539493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: feb837dc77134d96be67f955683b2d7d Oct 24 13:29:11.539493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-VolumesActionsTest-1088026127-project Oct 24 13:29:11.539493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:29:11.539493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Instance 767060a8-d6d0-40fc-a72e-2c0a900e2217 could not be found. Oct 24 13:29:11.539493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': '767060a8-d6d0-40fc-a72e-2c0a900e2217'} Oct 24 13:29:11.540392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:29:11.540392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:29:11.540392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:29:11.540392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:29:11.540392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:29:11.540392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:29:11.540392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:29:11.540392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:29:11.540392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:29:11.540392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:29:11.540392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 767060a8-d6d0-40fc-a72e-2c0a900e2217 could not be found. Oct 24 13:29:11.540392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:29:11.540392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:29:11.540392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:29:11.540392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:29:11.540392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:29:11.540392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:29:11.540392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:29:11.540392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:29:11.540392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:29:11.541881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:29:11.541881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:29:11.541881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:29:11.541881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:29:11.541881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:29:11.541881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:29:11.541881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:29:11.541881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 767060a8-d6d0-40fc-a72e-2c0a900e2217 could not be found. Oct 24 13:29:11.541881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:29:11.541881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:29:11.541881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:29:11.541881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:29:11.541881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:29:11.541881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:29:11.541881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:29:11.541881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:29:11.541881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 767060a8-d6d0-40fc-a72e-2c0a900e2217 could not be found. Oct 24 13:29:11.541881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:29:11.543119 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-2091b355-aa29-410c-a7b5-77b63404591e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Returning 404 to user: Instance 767060a8-d6d0-40fc-a72e-2c0a900e2217 could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:29:11.543119 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-2091b355-aa29-410c-a7b5-77b63404591e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217" status: 404 len: 111 microversion: 2.1 time: 0.030443 Oct 24 13:29:11.543119 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 254/507] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:11 2022] GET /compute/v2.1/servers/767060a8-d6d0-40fc-a72e-2c0a900e2217 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:29:11.641866 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9e06b550-dad4-41ee-ba6d-bd3bf5a9ba5d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-921197838", "imageRef": "1a874490-179e-412c-895e-52b16935c04c", "flavorRef": "452", "networks": [{"uuid": "fbe543ba-56bd-431b-a00d-2cf1782321b0"}]}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:29:11.693393 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.network.neutron [None req-9e06b550-dad4-41ee-ba6d-bd3bf5a9ba5d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] validate_networks() for [('fbe543ba-56bd-431b-a00d-2cf1782321b0', None, None, None, None, None)] {{(pid=119145) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:29:12.054319 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-9e06b550-dad4-41ee-ba6d-bd3bf5a9ba5d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Flavor limits 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:29:12.054818 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-9e06b550-dad4-41ee-ba6d-bd3bf5a9ba5d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Image limits 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:29:12.055356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-9e06b550-dad4-41ee-ba6d-bd3bf5a9ba5d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Flavor pref 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:29:12.055899 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-9e06b550-dad4-41ee-ba6d-bd3bf5a9ba5d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Image pref 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:29:12.056412 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-9e06b550-dad4-41ee-ba6d-bd3bf5a9ba5d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:29:12.065815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9e06b550-dad4-41ee-ba6d-bd3bf5a9ba5d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:12.066288 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9e06b550-dad4-41ee-ba6d-bd3bf5a9ba5d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:12.066707 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9e06b550-dad4-41ee-ba6d-bd3bf5a9ba5d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:12.067411 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9e06b550-dad4-41ee-ba6d-bd3bf5a9ba5d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:12.068023 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9e06b550-dad4-41ee-ba6d-bd3bf5a9ba5d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:12.068460 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9e06b550-dad4-41ee-ba6d-bd3bf5a9ba5d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:12.088480 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-9e06b550-dad4-41ee-ba6d-bd3bf5a9ba5d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Getting quotas for project 10316acf2adf4f34a63a08f0e60b2548. Resources: {'ram', 'instances', 'cores'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:29:12.092670 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-9e06b550-dad4-41ee-ba6d-bd3bf5a9ba5d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Getting quotas for user feb837dc77134d96be67f955683b2d7d and project 10316acf2adf4f34a63a08f0e60b2548. Resources: {'ram', 'instances', 'cores'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:29:12.104453 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9e06b550-dad4-41ee-ba6d-bd3bf5a9ba5d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Going to run 1 instances... {{(pid=119145) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:29:12.106767 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9e06b550-dad4-41ee-ba6d-bd3bf5a9ba5d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a874490-179e-412c-895e-52b16935c04c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119145) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:29:12.205293 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9e06b550-dad4-41ee-ba6d-bd3bf5a9ba5d tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567732 Oct 24 13:29:12.205940 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 254/508] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 24 13:29:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:29:12.218461 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8d2a37f0-fb5d-40a1-a6f9-c88975bdadeb tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:12.219071 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8d2a37f0-fb5d-40a1-a6f9-c88975bdadeb tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:12.271493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8d2a37f0-fb5d-40a1-a6f9-c88975bdadeb tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:12.278449 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8d2a37f0-fb5d-40a1-a6f9-c88975bdadeb tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1213 microversion: 2.1 time: 0.065154 Oct 24 13:29:12.279012 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 255/509] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:12 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:12.526583 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-dcf6ac07-4e35-497c-a92e-23bca1c4ea09 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:12.527190 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-4541004a-2537-4459-b3dd-b299b7b7200a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:12.527609 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-dcf6ac07-4e35-497c-a92e-23bca1c4ea09 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:12.527733 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-4541004a-2537-4459-b3dd-b299b7b7200a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:12.533527 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dcf6ac07-4e35-497c-a92e-23bca1c4ea09 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:12.534000 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dcf6ac07-4e35-497c-a92e-23bca1c4ea09 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:12.534108 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4541004a-2537-4459-b3dd-b299b7b7200a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:12.537211 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dcf6ac07-4e35-497c-a92e-23bca1c4ea09 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:12.537318 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4541004a-2537-4459-b3dd-b299b7b7200a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:12.537318 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4541004a-2537-4459-b3dd-b299b7b7200a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:12.537499 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dcf6ac07-4e35-497c-a92e-23bca1c4ea09 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:12.537499 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dcf6ac07-4e35-497c-a92e-23bca1c4ea09 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:12.537678 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4541004a-2537-4459-b3dd-b299b7b7200a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:12.537770 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dcf6ac07-4e35-497c-a92e-23bca1c4ea09 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:12.537874 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4541004a-2537-4459-b3dd-b299b7b7200a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:12.537874 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4541004a-2537-4459-b3dd-b299b7b7200a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:12.610204 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-dcf6ac07-4e35-497c-a92e-23bca1c4ea09 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:12.617886 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-dcf6ac07-4e35-497c-a92e-23bca1c4ea09 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1268 microversion: 2.1 time: 0.095090 Oct 24 13:29:12.618679 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 255/510] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:12 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1268 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:12.673506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-4541004a-2537-4459-b3dd-b299b7b7200a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:12.681078 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-4541004a-2537-4459-b3dd-b299b7b7200a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1370 microversion: 2.1 time: 0.158219 Oct 24 13:29:12.681631 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 256/511] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:12 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:13.300479 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-2b300fa9-ec81-4940-bc51-83f9ce17fda5 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:13.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-2b300fa9-ec81-4940-bc51-83f9ce17fda5 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:13.303114 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:13.307770 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2b300fa9-ec81-4940-bc51-83f9ce17fda5 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:13.308238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2b300fa9-ec81-4940-bc51-83f9ce17fda5 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:13.308690 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2b300fa9-ec81-4940-bc51-83f9ce17fda5 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:13.309458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2b300fa9-ec81-4940-bc51-83f9ce17fda5 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:13.309900 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2b300fa9-ec81-4940-bc51-83f9ce17fda5 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:13.310310 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2b300fa9-ec81-4940-bc51-83f9ce17fda5 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:13.415613 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-2b300fa9-ec81-4940-bc51-83f9ce17fda5 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:13.425348 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-2b300fa9-ec81-4940-bc51-83f9ce17fda5 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1209 microversion: 2.1 time: 0.128815 Oct 24 13:29:13.426077 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 256/512] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:13 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1209 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:13.619321 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c0e41fe8-a894-423a-ab04-ab88b4dc9b36 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9e836f8-b812-4276-8154-8443e6703aa8"}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:29:13.621711 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c0e41fe8-a894-423a-ab04-ab88b4dc9b36 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:13.632525 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c0e41fe8-a894-423a-ab04-ab88b4dc9b36 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:13.633016 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c0e41fe8-a894-423a-ab04-ab88b4dc9b36 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:13.633446 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c0e41fe8-a894-423a-ab04-ab88b4dc9b36 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:13.634142 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c0e41fe8-a894-423a-ab04-ab88b4dc9b36 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:13.634586 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c0e41fe8-a894-423a-ab04-ab88b4dc9b36 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:13.635006 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c0e41fe8-a894-423a-ab04-ab88b4dc9b36 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:13.642295 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-76e83bea-2dfd-4234-a991-d96e0a7903bc tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:13.643250 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-76e83bea-2dfd-4234-a991-d96e0a7903bc tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:13.649964 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76e83bea-2dfd-4234-a991-d96e0a7903bc tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:13.650640 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76e83bea-2dfd-4234-a991-d96e0a7903bc tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:13.654406 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76e83bea-2dfd-4234-a991-d96e0a7903bc tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:13.654406 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76e83bea-2dfd-4234-a991-d96e0a7903bc tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:13.654406 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76e83bea-2dfd-4234-a991-d96e0a7903bc tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:13.654406 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76e83bea-2dfd-4234-a991-d96e0a7903bc tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:13.878408 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-76e83bea-2dfd-4234-a991-d96e0a7903bc tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:13.886325 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-76e83bea-2dfd-4234-a991-d96e0a7903bc tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1316 microversion: 2.1 time: 0.248317 Oct 24 13:29:13.886888 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 257/513] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:13 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:13.891294 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-39115552-5ec7-44ec-9466-69a3af447fde tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:13.891915 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-39115552-5ec7-44ec-9466-69a3af447fde tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:13.897627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-39115552-5ec7-44ec-9466-69a3af447fde tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:13.898101 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-39115552-5ec7-44ec-9466-69a3af447fde tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:13.898530 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-39115552-5ec7-44ec-9466-69a3af447fde tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:13.899206 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-39115552-5ec7-44ec-9466-69a3af447fde tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:13.899653 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-39115552-5ec7-44ec-9466-69a3af447fde tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:13.900147 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-39115552-5ec7-44ec-9466-69a3af447fde tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:14.030658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-39115552-5ec7-44ec-9466-69a3af447fde tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:14.038311 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-39115552-5ec7-44ec-9466-69a3af447fde tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1562 microversion: 2.1 time: 0.150500 Oct 24 13:29:14.038879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 258/514] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:13 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:14.060861 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ef4d3de7-74f0-4120-92e8-d7f1da8cc7dc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:14.061289 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ef4d3de7-74f0-4120-92e8-d7f1da8cc7dc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:14.067214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ef4d3de7-74f0-4120-92e8-d7f1da8cc7dc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:14.067689 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ef4d3de7-74f0-4120-92e8-d7f1da8cc7dc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:14.068113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ef4d3de7-74f0-4120-92e8-d7f1da8cc7dc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:14.068821 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ef4d3de7-74f0-4120-92e8-d7f1da8cc7dc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:14.069254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ef4d3de7-74f0-4120-92e8-d7f1da8cc7dc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:14.069664 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ef4d3de7-74f0-4120-92e8-d7f1da8cc7dc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:14.083509 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=100 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:14.147983 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ef4d3de7-74f0-4120-92e8-d7f1da8cc7dc tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090806 Oct 24 13:29:14.148644 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 259/515] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 24 13:29:14 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:29:14.453210 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-cd0370d8-c1b8-4050-96c7-b61182c6b9e0 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:14.454059 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-cd0370d8-c1b8-4050-96c7-b61182c6b9e0 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:14.460572 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cd0370d8-c1b8-4050-96c7-b61182c6b9e0 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:14.460996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cd0370d8-c1b8-4050-96c7-b61182c6b9e0 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:14.461603 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cd0370d8-c1b8-4050-96c7-b61182c6b9e0 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:14.462452 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cd0370d8-c1b8-4050-96c7-b61182c6b9e0 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:14.463097 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cd0370d8-c1b8-4050-96c7-b61182c6b9e0 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:14.463668 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cd0370d8-c1b8-4050-96c7-b61182c6b9e0 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:14.581231 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-cd0370d8-c1b8-4050-96c7-b61182c6b9e0 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:14.590053 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-cd0370d8-c1b8-4050-96c7-b61182c6b9e0 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1273 microversion: 2.1 time: 0.141271 Oct 24 13:29:14.591192 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 260/516] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:14 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1273 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:14.718205 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c0e41fe8-a894-423a-ab04-ab88b4dc9b36 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "POST /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.102424 Oct 24 13:29:14.720036 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 257/517] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 24 13:29:13 2022] POST /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac/os-volume_attachments => generated 194 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:29:14.910686 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-3af1a8d6-84e5-45da-a0a7-71a496f7a274 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:14.911287 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-3af1a8d6-84e5-45da-a0a7-71a496f7a274 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:14.917300 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3af1a8d6-84e5-45da-a0a7-71a496f7a274 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:14.917771 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3af1a8d6-84e5-45da-a0a7-71a496f7a274 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:14.918196 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3af1a8d6-84e5-45da-a0a7-71a496f7a274 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:14.918863 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3af1a8d6-84e5-45da-a0a7-71a496f7a274 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:14.919302 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3af1a8d6-84e5-45da-a0a7-71a496f7a274 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:14.919710 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3af1a8d6-84e5-45da-a0a7-71a496f7a274 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:15.266578 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-3af1a8d6-84e5-45da-a0a7-71a496f7a274 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:15.275849 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-3af1a8d6-84e5-45da-a0a7-71a496f7a274 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1316 microversion: 2.1 time: 0.368806 Oct 24 13:29:15.276683 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 261/518] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:14 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1316 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:15.315759 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-62092606-240b-4257-8e70-5fe6cab64540 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:15.316490 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-62092606-240b-4257-8e70-5fe6cab64540 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:15.323371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-62092606-240b-4257-8e70-5fe6cab64540 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:15.323955 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-62092606-240b-4257-8e70-5fe6cab64540 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:15.324492 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-62092606-240b-4257-8e70-5fe6cab64540 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:15.325267 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-62092606-240b-4257-8e70-5fe6cab64540 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:15.325782 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-62092606-240b-4257-8e70-5fe6cab64540 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:15.326533 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-62092606-240b-4257-8e70-5fe6cab64540 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:15.351959 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-62092606-240b-4257-8e70-5fe6cab64540 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa/ips" status: 200 len: 146 microversion: 2.1 time: 0.041485 Oct 24 13:29:15.352886 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 258/519] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 24 13:29:15 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:29:15.615833 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f30a56fd-e7bd-41d2-9f49-ee1174d95e20 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:15.616602 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f30a56fd-e7bd-41d2-9f49-ee1174d95e20 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:15.623351 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f30a56fd-e7bd-41d2-9f49-ee1174d95e20 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:15.623606 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f30a56fd-e7bd-41d2-9f49-ee1174d95e20 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:15.624659 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f30a56fd-e7bd-41d2-9f49-ee1174d95e20 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:15.625809 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f30a56fd-e7bd-41d2-9f49-ee1174d95e20 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:15.625809 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f30a56fd-e7bd-41d2-9f49-ee1174d95e20 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:15.626192 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f30a56fd-e7bd-41d2-9f49-ee1174d95e20 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:15.648677 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-09c42984-b29c-4f63-828a-26ba7e49c488 req-77f1b460-11d3-4a18-beda-22aa20d736a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb595949-cb79-47e4-b760-6e9dfd97b222", "tag": "c2e4dc49-a4c3-4b4e-97ea-3d9c9f960383"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:29:15.669399 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-09c42984-b29c-4f63-828a-26ba7e49c488 req-77f1b460-11d3-4a18-beda-22aa20d736a2 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:15.669882 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-09c42984-b29c-4f63-828a-26ba7e49c488 req-77f1b460-11d3-4a18-beda-22aa20d736a2 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:15.670497 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-09c42984-b29c-4f63-828a-26ba7e49c488 req-77f1b460-11d3-4a18-beda-22aa20d736a2 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:15.684244 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-09c42984-b29c-4f63-828a-26ba7e49c488 req-77f1b460-11d3-4a18-beda-22aa20d736a2 service nova] Creating event network-changed:c2e4dc49-a4c3-4b4e-97ea-3d9c9f960383 for instance bb595949-cb79-47e4-b760-6e9dfd97b222 on hv-cinder-86249 Oct 24 13:29:15.691238 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-09c42984-b29c-4f63-828a-26ba7e49c488 req-77f1b460-11d3-4a18-beda-22aa20d736a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046658 Oct 24 13:29:15.692592 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 259/520] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:29:15.698753 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-434342dd-8cfb-4ee3-b159-66cd74f5d13d req-8f51ee28-3d9e-4431-bfb4-1c5354e7052e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "045d0b97-923d-4969-a8f5-664dbc753b93", "tag": "4be62649-dc27-4985-9ca2-ca391e7d9189"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:29:15.709967 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-434342dd-8cfb-4ee3-b159-66cd74f5d13d req-8f51ee28-3d9e-4431-bfb4-1c5354e7052e service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:15.710497 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-434342dd-8cfb-4ee3-b159-66cd74f5d13d req-8f51ee28-3d9e-4431-bfb4-1c5354e7052e service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:15.710923 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-434342dd-8cfb-4ee3-b159-66cd74f5d13d req-8f51ee28-3d9e-4431-bfb4-1c5354e7052e service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:15.726853 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-434342dd-8cfb-4ee3-b159-66cd74f5d13d req-8f51ee28-3d9e-4431-bfb4-1c5354e7052e service nova] Creating event network-changed:4be62649-dc27-4985-9ca2-ca391e7d9189 for instance 045d0b97-923d-4969-a8f5-664dbc753b93 on hv-cinder-86249 Oct 24 13:29:15.735490 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-434342dd-8cfb-4ee3-b159-66cd74f5d13d req-8f51ee28-3d9e-4431-bfb4-1c5354e7052e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041218 Oct 24 13:29:15.737098 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 260/521] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:29:16.221046 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f30a56fd-e7bd-41d2-9f49-ee1174d95e20 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:16.230335 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f30a56fd-e7bd-41d2-9f49-ee1174d95e20 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1313 microversion: 2.1 time: 0.618371 Oct 24 13:29:16.230914 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 262/522] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:15 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1313 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:16.302231 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a82830a9-98aa-484c-b2b7-5b59653e2634 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:16.302964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a82830a9-98aa-484c-b2b7-5b59653e2634 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:16.309613 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a82830a9-98aa-484c-b2b7-5b59653e2634 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:16.310093 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a82830a9-98aa-484c-b2b7-5b59653e2634 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:16.310534 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a82830a9-98aa-484c-b2b7-5b59653e2634 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:16.311216 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a82830a9-98aa-484c-b2b7-5b59653e2634 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:16.312176 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a82830a9-98aa-484c-b2b7-5b59653e2634 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:16.312617 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a82830a9-98aa-484c-b2b7-5b59653e2634 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:16.461119 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a82830a9-98aa-484c-b2b7-5b59653e2634 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:16.469859 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a82830a9-98aa-484c-b2b7-5b59653e2634 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1316 microversion: 2.1 time: 0.171778 Oct 24 13:29:16.470764 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 261/523] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:16 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:17.254886 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f00af185-e9c8-41f3-8917-606961328376 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:17.255490 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f00af185-e9c8-41f3-8917-606961328376 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:17.261549 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f00af185-e9c8-41f3-8917-606961328376 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:17.262067 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f00af185-e9c8-41f3-8917-606961328376 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:17.262484 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f00af185-e9c8-41f3-8917-606961328376 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:17.263158 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f00af185-e9c8-41f3-8917-606961328376 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:17.263605 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f00af185-e9c8-41f3-8917-606961328376 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:17.264049 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f00af185-e9c8-41f3-8917-606961328376 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:17.457024 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f00af185-e9c8-41f3-8917-606961328376 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:17.464606 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f00af185-e9c8-41f3-8917-606961328376 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1313 microversion: 2.1 time: 0.214118 Oct 24 13:29:17.465273 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 263/524] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:17 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:17.492772 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9f2e40c6-2e41-4b38-b73a-e2415c8f8ead tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:17.493385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-9f2e40c6-2e41-4b38-b73a-e2415c8f8ead tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:17.500280 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f2e40c6-2e41-4b38-b73a-e2415c8f8ead tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:17.500783 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f2e40c6-2e41-4b38-b73a-e2415c8f8ead tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:17.501213 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f2e40c6-2e41-4b38-b73a-e2415c8f8ead tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:17.501896 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f2e40c6-2e41-4b38-b73a-e2415c8f8ead tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:17.502345 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f2e40c6-2e41-4b38-b73a-e2415c8f8ead tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:17.502757 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f2e40c6-2e41-4b38-b73a-e2415c8f8ead tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:17.629316 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-9f2e40c6-2e41-4b38-b73a-e2415c8f8ead tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:17.637091 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9f2e40c6-2e41-4b38-b73a-e2415c8f8ead tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1316 microversion: 2.1 time: 0.148075 Oct 24 13:29:17.637862 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 262/525] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:17 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1316 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:17.753369 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-de0bd905-3767-4615-8110-7f7044d3e3cf req-5ef7182b-b605-4473-86b0-69f3a6fe6ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dc85d13-0b95-4517-a112-85b1891de1d1", "tag": "3a6ca3be-d5e0-4632-93da-954f72814543"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:29:17.762638 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-de0bd905-3767-4615-8110-7f7044d3e3cf req-5ef7182b-b605-4473-86b0-69f3a6fe6ec4 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:17.763099 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-de0bd905-3767-4615-8110-7f7044d3e3cf req-5ef7182b-b605-4473-86b0-69f3a6fe6ec4 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:17.763514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-de0bd905-3767-4615-8110-7f7044d3e3cf req-5ef7182b-b605-4473-86b0-69f3a6fe6ec4 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:17.774048 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-de0bd905-3767-4615-8110-7f7044d3e3cf req-5ef7182b-b605-4473-86b0-69f3a6fe6ec4 service nova] Creating event network-changed:3a6ca3be-d5e0-4632-93da-954f72814543 for instance 1dc85d13-0b95-4517-a112-85b1891de1d1 on hv-cinder-86249 Oct 24 13:29:17.778853 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-de0bd905-3767-4615-8110-7f7044d3e3cf req-5ef7182b-b605-4473-86b0-69f3a6fe6ec4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029150 Oct 24 13:29:17.779407 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 264/526] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:29:18.487243 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ec10b05c-d850-472a-9c1b-de546949821f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:18.487876 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-ec10b05c-d850-472a-9c1b-de546949821f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:18.493818 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ec10b05c-d850-472a-9c1b-de546949821f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:18.494391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ec10b05c-d850-472a-9c1b-de546949821f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:18.494699 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ec10b05c-d850-472a-9c1b-de546949821f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:18.495368 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ec10b05c-d850-472a-9c1b-de546949821f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:18.495809 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ec10b05c-d850-472a-9c1b-de546949821f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:18.496220 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ec10b05c-d850-472a-9c1b-de546949821f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:18.625972 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ec10b05c-d850-472a-9c1b-de546949821f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:18.628293 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:18.634347 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-ec10b05c-d850-472a-9c1b-de546949821f tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1313 microversion: 2.1 time: 0.150965 Oct 24 13:29:18.634920 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 263/527] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:18 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:18.661391 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f2f4604c-8cf7-4567-bfd1-b333feeee276 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:18.662225 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f2f4604c-8cf7-4567-bfd1-b333feeee276 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:18.668361 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f2f4604c-8cf7-4567-bfd1-b333feeee276 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:18.668788 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f2f4604c-8cf7-4567-bfd1-b333feeee276 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:18.669216 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f2f4604c-8cf7-4567-bfd1-b333feeee276 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:18.669888 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f2f4604c-8cf7-4567-bfd1-b333feeee276 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:18.670327 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f2f4604c-8cf7-4567-bfd1-b333feeee276 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:18.671322 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f2f4604c-8cf7-4567-bfd1-b333feeee276 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:18.800157 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f2f4604c-8cf7-4567-bfd1-b333feeee276 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:18.807766 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f2f4604c-8cf7-4567-bfd1-b333feeee276 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1316 microversion: 2.1 time: 0.150833 Oct 24 13:29:18.808337 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 265/528] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:18 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:19.553874 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-26fc0c72-4f91-4b95-9403-b013c25cac0a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:19.554448 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-26fc0c72-4f91-4b95-9403-b013c25cac0a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:19.561968 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-26fc0c72-4f91-4b95-9403-b013c25cac0a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:19.562445 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-26fc0c72-4f91-4b95-9403-b013c25cac0a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:19.562873 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-26fc0c72-4f91-4b95-9403-b013c25cac0a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:19.563581 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-26fc0c72-4f91-4b95-9403-b013c25cac0a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:19.564027 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-26fc0c72-4f91-4b95-9403-b013c25cac0a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:19.564479 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-26fc0c72-4f91-4b95-9403-b013c25cac0a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:19.587197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-26fc0c72-4f91-4b95-9403-b013c25cac0a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd/ips" status: 200 len: 151 microversion: 2.20 time: 0.037436 Oct 24 13:29:19.588393 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 264/529] 10.222.0.48 () {60 vars in 1289 bytes} [Mon Oct 24 13:29:19 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:29:19.656985 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ba3bc806-15ae-4546-8bd5-0f1774b1e1c1 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:19.657613 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ba3bc806-15ae-4546-8bd5-0f1774b1e1c1 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:19.663420 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba3bc806-15ae-4546-8bd5-0f1774b1e1c1 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:19.663984 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba3bc806-15ae-4546-8bd5-0f1774b1e1c1 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:19.664327 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba3bc806-15ae-4546-8bd5-0f1774b1e1c1 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:19.665000 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba3bc806-15ae-4546-8bd5-0f1774b1e1c1 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:19.665435 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba3bc806-15ae-4546-8bd5-0f1774b1e1c1 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:19.665851 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba3bc806-15ae-4546-8bd5-0f1774b1e1c1 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:19.796699 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ba3bc806-15ae-4546-8bd5-0f1774b1e1c1 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:19.804305 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ba3bc806-15ae-4546-8bd5-0f1774b1e1c1 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1313 microversion: 2.1 time: 0.151227 Oct 24 13:29:19.804812 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 266/530] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:19 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:19.830819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8aedb3f4-c676-4ee7-8583-dc4d61f4bd4d tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:19.831459 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8aedb3f4-c676-4ee7-8583-dc4d61f4bd4d tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:19.837728 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8aedb3f4-c676-4ee7-8583-dc4d61f4bd4d tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:19.838207 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8aedb3f4-c676-4ee7-8583-dc4d61f4bd4d tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:19.838661 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8aedb3f4-c676-4ee7-8583-dc4d61f4bd4d tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:19.839337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8aedb3f4-c676-4ee7-8583-dc4d61f4bd4d tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:19.839786 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8aedb3f4-c676-4ee7-8583-dc4d61f4bd4d tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:19.840207 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8aedb3f4-c676-4ee7-8583-dc4d61f4bd4d tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:19.970833 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8aedb3f4-c676-4ee7-8583-dc4d61f4bd4d tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:19.978821 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8aedb3f4-c676-4ee7-8583-dc4d61f4bd4d tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1316 microversion: 2.1 time: 0.152148 Oct 24 13:29:19.979559 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 265/531] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:19 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:20.826529 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-3e440dc3-462a-407d-bd74-9155cc2712f5 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:20.827133 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-3e440dc3-462a-407d-bd74-9155cc2712f5 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:20.833146 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3e440dc3-462a-407d-bd74-9155cc2712f5 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:20.833636 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3e440dc3-462a-407d-bd74-9155cc2712f5 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:20.834049 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3e440dc3-462a-407d-bd74-9155cc2712f5 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:20.834727 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3e440dc3-462a-407d-bd74-9155cc2712f5 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:20.835173 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3e440dc3-462a-407d-bd74-9155cc2712f5 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:20.835588 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3e440dc3-462a-407d-bd74-9155cc2712f5 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:21.002888 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9f0d2abd-1e47-4c6e-95d2-7aef1c785f87 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:21.003378 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-9f0d2abd-1e47-4c6e-95d2-7aef1c785f87 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:21.005522 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=2 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:21.011219 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f0d2abd-1e47-4c6e-95d2-7aef1c785f87 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:21.011699 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f0d2abd-1e47-4c6e-95d2-7aef1c785f87 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:21.012134 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f0d2abd-1e47-4c6e-95d2-7aef1c785f87 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:21.012842 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f0d2abd-1e47-4c6e-95d2-7aef1c785f87 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:21.013290 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f0d2abd-1e47-4c6e-95d2-7aef1c785f87 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:21.013717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9f0d2abd-1e47-4c6e-95d2-7aef1c785f87 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:21.042892 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-3e440dc3-462a-407d-bd74-9155cc2712f5 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:21.050946 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-3e440dc3-462a-407d-bd74-9155cc2712f5 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1313 microversion: 2.1 time: 0.228521 Oct 24 13:29:21.051611 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 267/532] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:20 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:21.156755 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-9f0d2abd-1e47-4c6e-95d2-7aef1c785f87 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:21.164319 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9f0d2abd-1e47-4c6e-95d2-7aef1c785f87 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1316 microversion: 2.1 time: 0.165385 Oct 24 13:29:21.164880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 266/533] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:20 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:21.488499 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6ea8e722-69ea-4f2f-a9c2-0c15b2a5edde tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cd4e1f4-1ec6-4e62-af9f-8877eeb11054"}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:29:21.490899 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-6ea8e722-69ea-4f2f-a9c2-0c15b2a5edde tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:21.496802 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ea8e722-69ea-4f2f-a9c2-0c15b2a5edde tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:21.497227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ea8e722-69ea-4f2f-a9c2-0c15b2a5edde tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:21.497651 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ea8e722-69ea-4f2f-a9c2-0c15b2a5edde tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:21.498323 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ea8e722-69ea-4f2f-a9c2-0c15b2a5edde tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:21.499300 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ea8e722-69ea-4f2f-a9c2-0c15b2a5edde tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:21.499714 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ea8e722-69ea-4f2f-a9c2-0c15b2a5edde tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:22.073099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-824f2309-4915-4f6e-94af-1234bc02ab07 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:22.073714 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-824f2309-4915-4f6e-94af-1234bc02ab07 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:22.075424 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=4 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:22.080711 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-824f2309-4915-4f6e-94af-1234bc02ab07 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:22.081201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-824f2309-4915-4f6e-94af-1234bc02ab07 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:22.081693 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-824f2309-4915-4f6e-94af-1234bc02ab07 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:22.082395 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-824f2309-4915-4f6e-94af-1234bc02ab07 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:22.082855 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-824f2309-4915-4f6e-94af-1234bc02ab07 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:22.083593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-824f2309-4915-4f6e-94af-1234bc02ab07 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:22.100313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=14 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:22.227035 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-824f2309-4915-4f6e-94af-1234bc02ab07 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:22.237243 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-824f2309-4915-4f6e-94af-1234bc02ab07 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1313 microversion: 2.1 time: 0.166980 Oct 24 13:29:22.237824 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 267/534] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:22 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:22.242882 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bd7927db-bc2a-4c49-99f0-20529195e4aa tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:22.243488 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bd7927db-bc2a-4c49-99f0-20529195e4aa tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:22.245300 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:22.252360 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bd7927db-bc2a-4c49-99f0-20529195e4aa tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:22.252924 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bd7927db-bc2a-4c49-99f0-20529195e4aa tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:22.253691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bd7927db-bc2a-4c49-99f0-20529195e4aa tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:22.255483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bd7927db-bc2a-4c49-99f0-20529195e4aa tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:22.256098 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bd7927db-bc2a-4c49-99f0-20529195e4aa tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:22.257049 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bd7927db-bc2a-4c49-99f0-20529195e4aa tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:22.289035 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=2 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:22.442794 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-bd7927db-bc2a-4c49-99f0-20529195e4aa tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:22.451307 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-bd7927db-bc2a-4c49-99f0-20529195e4aa tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1316 microversion: 2.1 time: 0.212006 Oct 24 13:29:22.465021 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 268/535] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:22 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:22.647214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6ea8e722-69ea-4f2f-a9c2-0c15b2a5edde tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "POST /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.162429 Oct 24 13:29:22.648225 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 268/536] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 24 13:29:21 2022] POST /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa/os-volume_attachments => generated 194 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:29:22.813670 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-302898b5-a3da-47da-8c34-5a124225a53c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:29:22.814448 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-302898b5-a3da-47da-8c34-5a124225a53c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:22.822379 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-302898b5-a3da-47da-8c34-5a124225a53c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:22.830535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-302898b5-a3da-47da-8c34-5a124225a53c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:22.831231 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-302898b5-a3da-47da-8c34-5a124225a53c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:22.831953 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-302898b5-a3da-47da-8c34-5a124225a53c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:22.832786 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-302898b5-a3da-47da-8c34-5a124225a53c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:22.833447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-302898b5-a3da-47da-8c34-5a124225a53c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:22.859896 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.objects.instance [None req-302898b5-a3da-47da-8c34-5a124225a53c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lazy-loading 'flavor' on Instance uuid d3d04bbb-034d-4cf1-a753-9c4cb48e92bd {{(pid=119146) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:29:23.261529 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-965226e2-e6f7-4010-82a5-5d290f43c80b tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:23.262334 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-965226e2-e6f7-4010-82a5-5d290f43c80b tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:23.268447 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-965226e2-e6f7-4010-82a5-5d290f43c80b tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:23.268918 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-965226e2-e6f7-4010-82a5-5d290f43c80b tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:23.269339 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-965226e2-e6f7-4010-82a5-5d290f43c80b tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:23.270041 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-965226e2-e6f7-4010-82a5-5d290f43c80b tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:23.270480 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-965226e2-e6f7-4010-82a5-5d290f43c80b tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:23.270893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-965226e2-e6f7-4010-82a5-5d290f43c80b tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:23.329862 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-302898b5-a3da-47da-8c34-5a124225a53c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "POST /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd/action" status: 202 len: 0 microversion: 2.20 time: 0.520852 Oct 24 13:29:23.331336 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 269/537] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 24 13:29:22 2022] POST /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:23.341971 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-394df3dd-9b5e-42d2-9285-800c0a2b62b8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:23.346006 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-394df3dd-9b5e-42d2-9285-800c0a2b62b8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:23.350595 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-394df3dd-9b5e-42d2-9285-800c0a2b62b8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:23.351077 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-394df3dd-9b5e-42d2-9285-800c0a2b62b8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:23.351757 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-394df3dd-9b5e-42d2-9285-800c0a2b62b8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:23.352732 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-394df3dd-9b5e-42d2-9285-800c0a2b62b8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:23.353265 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-394df3dd-9b5e-42d2-9285-800c0a2b62b8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:23.353771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-394df3dd-9b5e-42d2-9285-800c0a2b62b8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:23.415226 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-965226e2-e6f7-4010-82a5-5d290f43c80b tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:23.424261 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-965226e2-e6f7-4010-82a5-5d290f43c80b tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1313 microversion: 2.1 time: 0.167434 Oct 24 13:29:23.425060 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 269/538] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:23 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:23.429678 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-76254af7-3ce7-46bc-822b-6db568ca8045 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:23.430399 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-76254af7-3ce7-46bc-822b-6db568ca8045 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:23.436159 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76254af7-3ce7-46bc-822b-6db568ca8045 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:23.436779 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76254af7-3ce7-46bc-822b-6db568ca8045 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:23.438001 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76254af7-3ce7-46bc-822b-6db568ca8045 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:23.438888 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76254af7-3ce7-46bc-822b-6db568ca8045 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:23.439527 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76254af7-3ce7-46bc-822b-6db568ca8045 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:23.441241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76254af7-3ce7-46bc-822b-6db568ca8045 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:23.501961 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-394df3dd-9b5e-42d2-9285-800c0a2b62b8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:23.512570 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-394df3dd-9b5e-42d2-9285-800c0a2b62b8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:23.513994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-394df3dd-9b5e-42d2-9285-800c0a2b62b8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:23.515159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-394df3dd-9b5e-42d2-9285-800c0a2b62b8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.179382 Oct 24 13:29:23.515754 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 270/539] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:23 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:29:23.520236 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1cb9beb0-dc77-412e-bf58-8b09ffa62076 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:23.522767 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-1cb9beb0-dc77-412e-bf58-8b09ffa62076 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:23.526708 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1cb9beb0-dc77-412e-bf58-8b09ffa62076 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:23.527184 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1cb9beb0-dc77-412e-bf58-8b09ffa62076 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:23.527637 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1cb9beb0-dc77-412e-bf58-8b09ffa62076 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:23.528400 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1cb9beb0-dc77-412e-bf58-8b09ffa62076 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:23.528846 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1cb9beb0-dc77-412e-bf58-8b09ffa62076 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:23.529446 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1cb9beb0-dc77-412e-bf58-8b09ffa62076 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:23.573306 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-76254af7-3ce7-46bc-822b-6db568ca8045 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:23.582271 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-76254af7-3ce7-46bc-822b-6db568ca8045 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1595 microversion: 2.1 time: 0.156182 Oct 24 13:29:23.582909 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 270/540] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:23 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1595 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:23.666860 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1cb9beb0-dc77-412e-bf58-8b09ffa62076 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:23.675110 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1cb9beb0-dc77-412e-bf58-8b09ffa62076 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1316 microversion: 2.1 time: 0.158395 Oct 24 13:29:23.675676 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 271/541] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:23 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:24.449218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0c4764f2-5615-4440-8087-021f58929ae7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:24.449938 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0c4764f2-5615-4440-8087-021f58929ae7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:24.458738 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0c4764f2-5615-4440-8087-021f58929ae7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:24.459232 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0c4764f2-5615-4440-8087-021f58929ae7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:24.459700 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0c4764f2-5615-4440-8087-021f58929ae7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:24.461596 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0c4764f2-5615-4440-8087-021f58929ae7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:24.461740 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0c4764f2-5615-4440-8087-021f58929ae7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:24.462242 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0c4764f2-5615-4440-8087-021f58929ae7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:24.543077 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-88d7ff56-08e0-4fd7-8fac-7328fbfc5a9f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:24.543733 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-88d7ff56-08e0-4fd7-8fac-7328fbfc5a9f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:24.551120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-88d7ff56-08e0-4fd7-8fac-7328fbfc5a9f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:24.551597 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-88d7ff56-08e0-4fd7-8fac-7328fbfc5a9f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:24.552022 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-88d7ff56-08e0-4fd7-8fac-7328fbfc5a9f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:24.552866 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-88d7ff56-08e0-4fd7-8fac-7328fbfc5a9f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:24.553309 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-88d7ff56-08e0-4fd7-8fac-7328fbfc5a9f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:24.553721 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-88d7ff56-08e0-4fd7-8fac-7328fbfc5a9f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:24.616837 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0c4764f2-5615-4440-8087-021f58929ae7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:24.625654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0c4764f2-5615-4440-8087-021f58929ae7 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1313 microversion: 2.1 time: 0.180150 Oct 24 13:29:24.626778 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 271/542] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:24 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:24.689352 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-f3bf39fd-2495-4e61-9f98-6f1e40baf168 req-1d13ab41-838a-4930-9a1c-60d83a095898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "045d0b97-923d-4969-a8f5-664dbc753b93", "name": "network-vif-plugged", "status": "completed", "tag": "4be62649-dc27-4985-9ca2-ca391e7d9189"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:29:24.700086 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-f3bf39fd-2495-4e61-9f98-6f1e40baf168 req-1d13ab41-838a-4930-9a1c-60d83a095898 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:24.700679 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-f3bf39fd-2495-4e61-9f98-6f1e40baf168 req-1d13ab41-838a-4930-9a1c-60d83a095898 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:24.701423 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-f3bf39fd-2495-4e61-9f98-6f1e40baf168 req-1d13ab41-838a-4930-9a1c-60d83a095898 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:24.712668 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-f3bf39fd-2495-4e61-9f98-6f1e40baf168 req-1d13ab41-838a-4930-9a1c-60d83a095898 service nova] Creating event network-vif-plugged:4be62649-dc27-4985-9ca2-ca391e7d9189 for instance 045d0b97-923d-4969-a8f5-664dbc753b93 on hv-cinder-86249 Oct 24 13:29:24.718237 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-f3bf39fd-2495-4e61-9f98-6f1e40baf168 req-1d13ab41-838a-4930-9a1c-60d83a095898 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033673 Oct 24 13:29:24.718995 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 272/543] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:29:24.724197 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0ad96b88-ba36-4158-b9f2-233a043b3911 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:24.724942 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0ad96b88-ba36-4158-b9f2-233a043b3911 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:24.730956 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ad96b88-ba36-4158-b9f2-233a043b3911 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:24.731464 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ad96b88-ba36-4158-b9f2-233a043b3911 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:24.731885 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ad96b88-ba36-4158-b9f2-233a043b3911 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:24.732579 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ad96b88-ba36-4158-b9f2-233a043b3911 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:24.733019 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ad96b88-ba36-4158-b9f2-233a043b3911 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:24.733601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ad96b88-ba36-4158-b9f2-233a043b3911 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:24.836612 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-88d7ff56-08e0-4fd7-8fac-7328fbfc5a9f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:24.845704 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-88d7ff56-08e0-4fd7-8fac-7328fbfc5a9f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:24.847136 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-88d7ff56-08e0-4fd7-8fac-7328fbfc5a9f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:24.848371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-88d7ff56-08e0-4fd7-8fac-7328fbfc5a9f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.309927 Oct 24 13:29:24.848939 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 272/544] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:24 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:24.873598 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0ad96b88-ba36-4158-b9f2-233a043b3911 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:24.881859 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0ad96b88-ba36-4158-b9f2-233a043b3911 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1316 microversion: 2.1 time: 0.161759 Oct 24 13:29:24.882424 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 273/545] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:24 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:25.648736 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bac8c13e-c32a-40b1-8d22-92bda5e94f99 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:25.649424 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bac8c13e-c32a-40b1-8d22-92bda5e94f99 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:25.656739 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bac8c13e-c32a-40b1-8d22-92bda5e94f99 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:25.657326 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bac8c13e-c32a-40b1-8d22-92bda5e94f99 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:25.657840 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bac8c13e-c32a-40b1-8d22-92bda5e94f99 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:25.658604 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bac8c13e-c32a-40b1-8d22-92bda5e94f99 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:25.659121 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bac8c13e-c32a-40b1-8d22-92bda5e94f99 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:25.659609 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bac8c13e-c32a-40b1-8d22-92bda5e94f99 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:25.734873 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-b133dcb8-5530-4fe3-bf87-6c3240c4b001 req-b4752acd-6a89-43e5-872e-837817a8a40a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47783c4e-2d71-46f8-a964-e268979915ac", "tag": "600465f3-a863-40a8-8e98-8ea8cd65d5a3"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:29:25.744981 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-b133dcb8-5530-4fe3-bf87-6c3240c4b001 req-b4752acd-6a89-43e5-872e-837817a8a40a service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:25.745597 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-b133dcb8-5530-4fe3-bf87-6c3240c4b001 req-b4752acd-6a89-43e5-872e-837817a8a40a service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:25.746212 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-b133dcb8-5530-4fe3-bf87-6c3240c4b001 req-b4752acd-6a89-43e5-872e-837817a8a40a service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:25.758676 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-b133dcb8-5530-4fe3-bf87-6c3240c4b001 req-b4752acd-6a89-43e5-872e-837817a8a40a service nova] Creating event network-changed:600465f3-a863-40a8-8e98-8ea8cd65d5a3 for instance 47783c4e-2d71-46f8-a964-e268979915ac on hv-cinder-86249 Oct 24 13:29:25.763895 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-b133dcb8-5530-4fe3-bf87-6c3240c4b001 req-b4752acd-6a89-43e5-872e-837817a8a40a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033742 Oct 24 13:29:25.764944 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 274/546] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:29:25.818281 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-bac8c13e-c32a-40b1-8d22-92bda5e94f99 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:25.826719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-bac8c13e-c32a-40b1-8d22-92bda5e94f99 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1313 microversion: 2.1 time: 0.181401 Oct 24 13:29:25.827295 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 273/547] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:25 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:25.879346 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-424f4fdc-a061-42fb-9cf5-ea38da66f6a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:25.882096 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-424f4fdc-a061-42fb-9cf5-ea38da66f6a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:25.887847 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-424f4fdc-a061-42fb-9cf5-ea38da66f6a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:25.888339 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-424f4fdc-a061-42fb-9cf5-ea38da66f6a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:25.888763 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-424f4fdc-a061-42fb-9cf5-ea38da66f6a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:25.889666 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-424f4fdc-a061-42fb-9cf5-ea38da66f6a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:25.890108 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-424f4fdc-a061-42fb-9cf5-ea38da66f6a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:25.891375 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-424f4fdc-a061-42fb-9cf5-ea38da66f6a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:25.906755 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3a7f7897-c425-4338-8e17-642985b9829e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:25.907365 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-3a7f7897-c425-4338-8e17-642985b9829e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:25.913735 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3a7f7897-c425-4338-8e17-642985b9829e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:25.914448 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3a7f7897-c425-4338-8e17-642985b9829e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:25.915109 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3a7f7897-c425-4338-8e17-642985b9829e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:25.915964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3a7f7897-c425-4338-8e17-642985b9829e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:25.916583 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3a7f7897-c425-4338-8e17-642985b9829e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:25.917148 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3a7f7897-c425-4338-8e17-642985b9829e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:26.045502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-424f4fdc-a061-42fb-9cf5-ea38da66f6a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:26.053866 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-424f4fdc-a061-42fb-9cf5-ea38da66f6a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:26.055293 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-424f4fdc-a061-42fb-9cf5-ea38da66f6a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:26.056469 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-424f4fdc-a061-42fb-9cf5-ea38da66f6a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.185645 Oct 24 13:29:26.057054 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 275/548] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:25 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:26.083498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3a7f7897-c425-4338-8e17-642985b9829e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:26.095774 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3a7f7897-c425-4338-8e17-642985b9829e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1316 microversion: 2.1 time: 0.192759 Oct 24 13:29:26.096913 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 274/549] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:25 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:26.855332 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a9f55edd-20a9-4e97-ab92-99d8aa089798 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:26.855332 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a9f55edd-20a9-4e97-ab92-99d8aa089798 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:26.862381 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a9f55edd-20a9-4e97-ab92-99d8aa089798 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:26.863212 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a9f55edd-20a9-4e97-ab92-99d8aa089798 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:26.863946 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a9f55edd-20a9-4e97-ab92-99d8aa089798 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:26.864681 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a9f55edd-20a9-4e97-ab92-99d8aa089798 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:26.865281 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a9f55edd-20a9-4e97-ab92-99d8aa089798 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:26.865695 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a9f55edd-20a9-4e97-ab92-99d8aa089798 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:27.002675 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a9f55edd-20a9-4e97-ab92-99d8aa089798 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:27.010386 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a9f55edd-20a9-4e97-ab92-99d8aa089798 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1313 microversion: 2.1 time: 0.161591 Oct 24 13:29:27.011089 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 276/550] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:26 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:27.084819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-da0e054a-3eda-44d4-8e59-0defe55d3eb2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:27.085413 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-da0e054a-3eda-44d4-8e59-0defe55d3eb2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:27.093157 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-da0e054a-3eda-44d4-8e59-0defe55d3eb2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:27.093848 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-da0e054a-3eda-44d4-8e59-0defe55d3eb2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:27.094417 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-da0e054a-3eda-44d4-8e59-0defe55d3eb2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:27.095256 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-da0e054a-3eda-44d4-8e59-0defe55d3eb2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:27.095856 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-da0e054a-3eda-44d4-8e59-0defe55d3eb2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:27.096806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-da0e054a-3eda-44d4-8e59-0defe55d3eb2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:27.120600 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-d3e16b07-07d7-46f8-a13c-5e223e8446ae tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:27.125719 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-d3e16b07-07d7-46f8-a13c-5e223e8446ae tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:27.127687 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d3e16b07-07d7-46f8-a13c-5e223e8446ae tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:27.128168 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d3e16b07-07d7-46f8-a13c-5e223e8446ae tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:27.128628 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d3e16b07-07d7-46f8-a13c-5e223e8446ae tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:27.129318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d3e16b07-07d7-46f8-a13c-5e223e8446ae tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:27.129770 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d3e16b07-07d7-46f8-a13c-5e223e8446ae tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:27.130192 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d3e16b07-07d7-46f8-a13c-5e223e8446ae tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:27.133049 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:27.245081 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-da0e054a-3eda-44d4-8e59-0defe55d3eb2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:27.250207 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-da0e054a-3eda-44d4-8e59-0defe55d3eb2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:27.251632 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-da0e054a-3eda-44d4-8e59-0defe55d3eb2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:27.252817 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-da0e054a-3eda-44d4-8e59-0defe55d3eb2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.172394 Oct 24 13:29:27.253369 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 275/551] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:27 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:29:27.384074 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-d3e16b07-07d7-46f8-a13c-5e223e8446ae tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:27.391836 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-d3e16b07-07d7-46f8-a13c-5e223e8446ae tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1316 microversion: 2.1 time: 0.275755 Oct 24 13:29:27.404659 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 277/552] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:27 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:28.032438 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-07715404-29ec-4c37-80b1-ef3a6e51ed30 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:28.033181 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-07715404-29ec-4c37-80b1-ef3a6e51ed30 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:28.039114 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-07715404-29ec-4c37-80b1-ef3a6e51ed30 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:28.039652 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-07715404-29ec-4c37-80b1-ef3a6e51ed30 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:28.040086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-07715404-29ec-4c37-80b1-ef3a6e51ed30 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:28.040801 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-07715404-29ec-4c37-80b1-ef3a6e51ed30 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:28.041253 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-07715404-29ec-4c37-80b1-ef3a6e51ed30 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:28.041669 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-07715404-29ec-4c37-80b1-ef3a6e51ed30 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:28.172484 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-07715404-29ec-4c37-80b1-ef3a6e51ed30 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:28.182111 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-07715404-29ec-4c37-80b1-ef3a6e51ed30 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1313 microversion: 2.1 time: 0.153462 Oct 24 13:29:28.183231 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 276/553] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:28 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:28.262356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-1e5cf022-a878-4aad-8f2f-245c67987eed tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-260171931"}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:29:28.262923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-1e5cf022-a878-4aad-8f2f-245c67987eed tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:28.270308 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1e5cf022-a878-4aad-8f2f-245c67987eed tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:28.270782 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1e5cf022-a878-4aad-8f2f-245c67987eed tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:28.271201 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1e5cf022-a878-4aad-8f2f-245c67987eed tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:28.272068 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1e5cf022-a878-4aad-8f2f-245c67987eed tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:28.272553 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1e5cf022-a878-4aad-8f2f-245c67987eed tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:28.272962 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1e5cf022-a878-4aad-8f2f-245c67987eed tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:28.279199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a43afd52-392a-4f21-b5a6-31ba6f64397d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:28.280142 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a43afd52-392a-4f21-b5a6-31ba6f64397d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:28.287089 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a43afd52-392a-4f21-b5a6-31ba6f64397d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:28.287821 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a43afd52-392a-4f21-b5a6-31ba6f64397d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:28.288342 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a43afd52-392a-4f21-b5a6-31ba6f64397d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:28.289103 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a43afd52-392a-4f21-b5a6-31ba6f64397d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:28.289622 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a43afd52-392a-4f21-b5a6-31ba6f64397d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:28.290660 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a43afd52-392a-4f21-b5a6-31ba6f64397d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:28.426626 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a43afd52-392a-4f21-b5a6-31ba6f64397d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:28.435801 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a43afd52-392a-4f21-b5a6-31ba6f64397d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:28.438297 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a43afd52-392a-4f21-b5a6-31ba6f64397d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:28.440760 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a43afd52-392a-4f21-b5a6-31ba6f64397d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.164484 Oct 24 13:29:28.440760 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 277/554] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:28 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:29:28.445826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-22cc3aa6-3d46-43b0-9c64-07356f479e4e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:28.446446 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-22cc3aa6-3d46-43b0-9c64-07356f479e4e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:28.452826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-22cc3aa6-3d46-43b0-9c64-07356f479e4e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:28.453307 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-22cc3aa6-3d46-43b0-9c64-07356f479e4e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:28.453736 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-22cc3aa6-3d46-43b0-9c64-07356f479e4e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:28.454425 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-22cc3aa6-3d46-43b0-9c64-07356f479e4e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:28.454872 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-22cc3aa6-3d46-43b0-9c64-07356f479e4e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:28.455642 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-22cc3aa6-3d46-43b0-9c64-07356f479e4e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:28.527194 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.network.security_group_api [None req-1e5cf022-a878-4aad-8f2f-245c67987eed tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Adding security group 82ad26cd-2938-472e-8225-5d5c9ce839ee to port 600465f3-a863-40a8-8e98-8ea8cd65d5a3 Oct 24 13:29:28.600080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-22cc3aa6-3d46-43b0-9c64-07356f479e4e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:28.602546 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:28.609686 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-22cc3aa6-3d46-43b0-9c64-07356f479e4e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1316 microversion: 2.1 time: 0.167401 Oct 24 13:29:28.610261 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 278/555] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:28 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:28.883310 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-1e5cf022-a878-4aad-8f2f-245c67987eed tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "POST /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac/action" status: 202 len: 0 microversion: 2.1 time: 0.625241 Oct 24 13:29:28.883906 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 278/556] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 24 13:29:28 2022] POST /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac/action => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:29:28.892231 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-181516b5-60a0-46fc-8003-9ace5c7c945d req-8ad49870-9285-433f-a60b-f8350d559ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47783c4e-2d71-46f8-a964-e268979915ac", "tag": "600465f3-a863-40a8-8e98-8ea8cd65d5a3"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:29:28.892476 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b655fb91-95d3-4db5-9c85-0cc1f374ffac tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:28.893065 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b655fb91-95d3-4db5-9c85-0cc1f374ffac tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:28.899913 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b655fb91-95d3-4db5-9c85-0cc1f374ffac tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:28.900387 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b655fb91-95d3-4db5-9c85-0cc1f374ffac tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:28.900819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b655fb91-95d3-4db5-9c85-0cc1f374ffac tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:28.901507 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b655fb91-95d3-4db5-9c85-0cc1f374ffac tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:28.901720 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-181516b5-60a0-46fc-8003-9ace5c7c945d req-8ad49870-9285-433f-a60b-f8350d559ddb service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:28.901957 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b655fb91-95d3-4db5-9c85-0cc1f374ffac tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:28.902180 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-181516b5-60a0-46fc-8003-9ace5c7c945d req-8ad49870-9285-433f-a60b-f8350d559ddb service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:28.902370 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b655fb91-95d3-4db5-9c85-0cc1f374ffac tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:28.902594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-181516b5-60a0-46fc-8003-9ace5c7c945d req-8ad49870-9285-433f-a60b-f8350d559ddb service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:28.915738 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-181516b5-60a0-46fc-8003-9ace5c7c945d req-8ad49870-9285-433f-a60b-f8350d559ddb service nova] Creating event network-changed:600465f3-a863-40a8-8e98-8ea8cd65d5a3 for instance 47783c4e-2d71-46f8-a964-e268979915ac on hv-cinder-86249 Oct 24 13:29:28.922472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-181516b5-60a0-46fc-8003-9ace5c7c945d req-8ad49870-9285-433f-a60b-f8350d559ddb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033267 Oct 24 13:29:28.923378 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 279/557] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:29:29.047199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b655fb91-95d3-4db5-9c85-0cc1f374ffac tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:29.055629 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b655fb91-95d3-4db5-9c85-0cc1f374ffac tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1759 microversion: 2.1 time: 0.167063 Oct 24 13:29:29.056420 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 279/558] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:28 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:29.206954 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e7908a13-f635-407a-a0af-e6f96b443ad3 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:29.207647 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e7908a13-f635-407a-a0af-e6f96b443ad3 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:29.214762 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e7908a13-f635-407a-a0af-e6f96b443ad3 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:29.215245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e7908a13-f635-407a-a0af-e6f96b443ad3 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:29.215672 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e7908a13-f635-407a-a0af-e6f96b443ad3 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:29.216656 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e7908a13-f635-407a-a0af-e6f96b443ad3 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:29.217109 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e7908a13-f635-407a-a0af-e6f96b443ad3 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:29.217523 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e7908a13-f635-407a-a0af-e6f96b443ad3 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:29.353606 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e7908a13-f635-407a-a0af-e6f96b443ad3 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:29.363528 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e7908a13-f635-407a-a0af-e6f96b443ad3 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1313 microversion: 2.1 time: 0.161300 Oct 24 13:29:29.373737 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 280/559] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:29 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:29.466235 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ddf2c560-9373-43a6-a840-c1c6c25188dd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:29.466952 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-ddf2c560-9373-43a6-a840-c1c6c25188dd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:29.474243 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ddf2c560-9373-43a6-a840-c1c6c25188dd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:29.476949 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ddf2c560-9373-43a6-a840-c1c6c25188dd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:29.476949 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ddf2c560-9373-43a6-a840-c1c6c25188dd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:29.476949 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ddf2c560-9373-43a6-a840-c1c6c25188dd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:29.476949 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ddf2c560-9373-43a6-a840-c1c6c25188dd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:29.477297 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ddf2c560-9373-43a6-a840-c1c6c25188dd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:29.534150 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-7e11e416-d98c-4220-992d-c4d4a23fecf4 req-def0bd2e-b454-4337-81f2-26a42f406c96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc85d13-0b95-4517-a112-85b1891de1d1", "name": "network-vif-plugged", "status": "completed", "tag": "3a6ca3be-d5e0-4632-93da-954f72814543"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:29:29.551788 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-7e11e416-d98c-4220-992d-c4d4a23fecf4 req-def0bd2e-b454-4337-81f2-26a42f406c96 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:29.552510 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-7e11e416-d98c-4220-992d-c4d4a23fecf4 req-def0bd2e-b454-4337-81f2-26a42f406c96 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:29.553275 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-7e11e416-d98c-4220-992d-c4d4a23fecf4 req-def0bd2e-b454-4337-81f2-26a42f406c96 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:29.574291 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-7e11e416-d98c-4220-992d-c4d4a23fecf4 req-def0bd2e-b454-4337-81f2-26a42f406c96 service nova] Creating event network-vif-plugged:3a6ca3be-d5e0-4632-93da-954f72814543 for instance 1dc85d13-0b95-4517-a112-85b1891de1d1 on hv-cinder-86249 Oct 24 13:29:29.582675 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-7e11e416-d98c-4220-992d-c4d4a23fecf4 req-def0bd2e-b454-4337-81f2-26a42f406c96 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053932 Oct 24 13:29:29.584367 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 281/560] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:29:29.623454 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ddf2c560-9373-43a6-a840-c1c6c25188dd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:29.633747 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ddf2c560-9373-43a6-a840-c1c6c25188dd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:29.635213 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ddf2c560-9373-43a6-a840-c1c6c25188dd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:29.635761 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a5ec53d3-7784-4975-bb21-af4daf0e9885 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:29.636573 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-ddf2c560-9373-43a6-a840-c1c6c25188dd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.174926 Oct 24 13:29:29.636797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a5ec53d3-7784-4975-bb21-af4daf0e9885 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:29.652290 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 280/561] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:29 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:29.653915 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a5ec53d3-7784-4975-bb21-af4daf0e9885 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:29.653915 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a5ec53d3-7784-4975-bb21-af4daf0e9885 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:29.653915 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a5ec53d3-7784-4975-bb21-af4daf0e9885 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:29.653915 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a5ec53d3-7784-4975-bb21-af4daf0e9885 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:29.654318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a5ec53d3-7784-4975-bb21-af4daf0e9885 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:29.654318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a5ec53d3-7784-4975-bb21-af4daf0e9885 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:29.786135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a5ec53d3-7784-4975-bb21-af4daf0e9885 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:29.793938 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a5ec53d3-7784-4975-bb21-af4daf0e9885 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1505 microversion: 2.1 time: 0.163239 Oct 24 13:29:29.794504 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 282/562] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:29 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:30.386787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5a8d43b2-6a8c-4500-a4d0-a2106fa7a250 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:30.387352 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5a8d43b2-6a8c-4500-a4d0-a2106fa7a250 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:30.393600 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5a8d43b2-6a8c-4500-a4d0-a2106fa7a250 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:30.394084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5a8d43b2-6a8c-4500-a4d0-a2106fa7a250 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:30.396030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5a8d43b2-6a8c-4500-a4d0-a2106fa7a250 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:30.396030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5a8d43b2-6a8c-4500-a4d0-a2106fa7a250 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:30.396030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5a8d43b2-6a8c-4500-a4d0-a2106fa7a250 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:30.396030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5a8d43b2-6a8c-4500-a4d0-a2106fa7a250 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:30.552577 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5a8d43b2-6a8c-4500-a4d0-a2106fa7a250 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:30.560079 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5a8d43b2-6a8c-4500-a4d0-a2106fa7a250 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1313 microversion: 2.1 time: 0.177406 Oct 24 13:29:30.560727 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 281/563] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:30 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:30.663573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-1b97c726-7deb-4037-af19-e20a0acd5a63 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:30.664178 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-1b97c726-7deb-4037-af19-e20a0acd5a63 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:30.670570 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1b97c726-7deb-4037-af19-e20a0acd5a63 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:30.671038 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1b97c726-7deb-4037-af19-e20a0acd5a63 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:30.672011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1b97c726-7deb-4037-af19-e20a0acd5a63 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:30.672794 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1b97c726-7deb-4037-af19-e20a0acd5a63 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:30.673243 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1b97c726-7deb-4037-af19-e20a0acd5a63 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:30.673655 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1b97c726-7deb-4037-af19-e20a0acd5a63 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:30.801025 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1b97c726-7deb-4037-af19-e20a0acd5a63 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:30.809055 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1b97c726-7deb-4037-af19-e20a0acd5a63 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:30.810485 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1b97c726-7deb-4037-af19-e20a0acd5a63 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:30.811631 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-1b97c726-7deb-4037-af19-e20a0acd5a63 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.151984 Oct 24 13:29:30.812280 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 283/564] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:30 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:31.583131 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3d9894cf-808f-4f8e-91f1-d76a3a37034e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:31.583732 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-3d9894cf-808f-4f8e-91f1-d76a3a37034e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:31.590104 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3d9894cf-808f-4f8e-91f1-d76a3a37034e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:31.590572 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3d9894cf-808f-4f8e-91f1-d76a3a37034e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:31.591000 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3d9894cf-808f-4f8e-91f1-d76a3a37034e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:31.591670 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3d9894cf-808f-4f8e-91f1-d76a3a37034e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:31.592111 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3d9894cf-808f-4f8e-91f1-d76a3a37034e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:31.592548 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3d9894cf-808f-4f8e-91f1-d76a3a37034e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:31.722932 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3d9894cf-808f-4f8e-91f1-d76a3a37034e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:31.730522 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3d9894cf-808f-4f8e-91f1-d76a3a37034e tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1313 microversion: 2.1 time: 0.151142 Oct 24 13:29:31.731253 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 282/565] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:31 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:31.837647 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9ce0d907-fd43-49f2-9443-7421db7c3a88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:31.838186 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9ce0d907-fd43-49f2-9443-7421db7c3a88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:31.845159 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ce0d907-fd43-49f2-9443-7421db7c3a88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:31.845626 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ce0d907-fd43-49f2-9443-7421db7c3a88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:31.846055 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ce0d907-fd43-49f2-9443-7421db7c3a88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:31.846721 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ce0d907-fd43-49f2-9443-7421db7c3a88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:31.847162 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ce0d907-fd43-49f2-9443-7421db7c3a88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:31.847566 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ce0d907-fd43-49f2-9443-7421db7c3a88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:31.976695 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9ce0d907-fd43-49f2-9443-7421db7c3a88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:31.985746 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9ce0d907-fd43-49f2-9443-7421db7c3a88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:31.987182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9ce0d907-fd43-49f2-9443-7421db7c3a88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:31.988395 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9ce0d907-fd43-49f2-9443-7421db7c3a88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.154723 Oct 24 13:29:31.988963 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 284/566] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:31 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:32.757032 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-fc898f97-2e6d-4ed5-a7ba-da6cc075e4ec tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:32.757647 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-fc898f97-2e6d-4ed5-a7ba-da6cc075e4ec tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:32.765105 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc898f97-2e6d-4ed5-a7ba-da6cc075e4ec tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:32.766374 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc898f97-2e6d-4ed5-a7ba-da6cc075e4ec tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:32.766918 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc898f97-2e6d-4ed5-a7ba-da6cc075e4ec tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:32.767790 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc898f97-2e6d-4ed5-a7ba-da6cc075e4ec tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:32.768344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc898f97-2e6d-4ed5-a7ba-da6cc075e4ec tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:32.768775 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc898f97-2e6d-4ed5-a7ba-da6cc075e4ec tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:32.897328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fc898f97-2e6d-4ed5-a7ba-da6cc075e4ec tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:32.905839 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-fc898f97-2e6d-4ed5-a7ba-da6cc075e4ec tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1313 microversion: 2.1 time: 0.152447 Oct 24 13:29:32.906678 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 283/567] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:32 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:33.013856 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-227b74ab-a4e4-44e3-bf04-c6a83246fb85 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:33.014464 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-227b74ab-a4e4-44e3-bf04-c6a83246fb85 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:33.021018 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-227b74ab-a4e4-44e3-bf04-c6a83246fb85 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:33.021494 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-227b74ab-a4e4-44e3-bf04-c6a83246fb85 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:33.021923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-227b74ab-a4e4-44e3-bf04-c6a83246fb85 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:33.022608 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-227b74ab-a4e4-44e3-bf04-c6a83246fb85 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:33.023056 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-227b74ab-a4e4-44e3-bf04-c6a83246fb85 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:33.023549 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-227b74ab-a4e4-44e3-bf04-c6a83246fb85 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:33.150858 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-227b74ab-a4e4-44e3-bf04-c6a83246fb85 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:33.158898 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-227b74ab-a4e4-44e3-bf04-c6a83246fb85 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:33.160333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-227b74ab-a4e4-44e3-bf04-c6a83246fb85 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:33.161467 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-227b74ab-a4e4-44e3-bf04-c6a83246fb85 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.151487 Oct 24 13:29:33.162217 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 285/568] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:33 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:33.930272 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-143a8d28-5ca3-420f-a099-517f9036a861 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:33.930930 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-143a8d28-5ca3-420f-a099-517f9036a861 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:33.937776 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-143a8d28-5ca3-420f-a099-517f9036a861 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:33.939097 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-143a8d28-5ca3-420f-a099-517f9036a861 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:33.939546 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-143a8d28-5ca3-420f-a099-517f9036a861 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:33.940414 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-143a8d28-5ca3-420f-a099-517f9036a861 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:33.940888 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-143a8d28-5ca3-420f-a099-517f9036a861 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:33.941417 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-143a8d28-5ca3-420f-a099-517f9036a861 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:34.074096 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-143a8d28-5ca3-420f-a099-517f9036a861 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:34.082154 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-143a8d28-5ca3-420f-a099-517f9036a861 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1496 microversion: 2.1 time: 0.155766 Oct 24 13:29:34.092392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 284/569] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:33 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1496 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:34.187456 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-47df34d6-9107-497d-851c-9ac823cbe233 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:34.188260 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-47df34d6-9107-497d-851c-9ac823cbe233 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:34.195101 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-47df34d6-9107-497d-851c-9ac823cbe233 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:34.195578 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-47df34d6-9107-497d-851c-9ac823cbe233 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:34.196003 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-47df34d6-9107-497d-851c-9ac823cbe233 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:34.196705 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-47df34d6-9107-497d-851c-9ac823cbe233 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:34.197154 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-47df34d6-9107-497d-851c-9ac823cbe233 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:34.197558 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-47df34d6-9107-497d-851c-9ac823cbe233 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:34.329896 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-47df34d6-9107-497d-851c-9ac823cbe233 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:34.338811 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-47df34d6-9107-497d-851c-9ac823cbe233 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:34.340251 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-47df34d6-9107-497d-851c-9ac823cbe233 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:34.341465 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-47df34d6-9107-497d-851c-9ac823cbe233 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.158267 Oct 24 13:29:34.342073 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 286/570] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:34 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:35.159151 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-22c8f0fa-c0c6-4921-9c74-d46e22b65687 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:35.159745 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-22c8f0fa-c0c6-4921-9c74-d46e22b65687 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:35.166160 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-22c8f0fa-c0c6-4921-9c74-d46e22b65687 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:35.166630 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-22c8f0fa-c0c6-4921-9c74-d46e22b65687 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:35.167055 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-22c8f0fa-c0c6-4921-9c74-d46e22b65687 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:35.167732 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-22c8f0fa-c0c6-4921-9c74-d46e22b65687 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:35.168176 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-22c8f0fa-c0c6-4921-9c74-d46e22b65687 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:35.168621 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-22c8f0fa-c0c6-4921-9c74-d46e22b65687 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:35.195526 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-22c8f0fa-c0c6-4921-9c74-d46e22b65687 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Going to try to terminate instance {{(pid=119146) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:29:35.368328 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-de14194d-5ba0-4514-9fe9-9703b091b40e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:35.369479 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-de14194d-5ba0-4514-9fe9-9703b091b40e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:35.375739 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-de14194d-5ba0-4514-9fe9-9703b091b40e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:35.376249 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-de14194d-5ba0-4514-9fe9-9703b091b40e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:35.376776 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-de14194d-5ba0-4514-9fe9-9703b091b40e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:35.377519 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-de14194d-5ba0-4514-9fe9-9703b091b40e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:35.377986 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-de14194d-5ba0-4514-9fe9-9703b091b40e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:35.378405 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-de14194d-5ba0-4514-9fe9-9703b091b40e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:35.522519 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-de14194d-5ba0-4514-9fe9-9703b091b40e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:35.530641 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-de14194d-5ba0-4514-9fe9-9703b091b40e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:35.532169 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-de14194d-5ba0-4514-9fe9-9703b091b40e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:35.538284 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-de14194d-5ba0-4514-9fe9-9703b091b40e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.169467 Oct 24 13:29:35.538284 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 287/571] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:35 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:29:35.544560 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-4786d982-8067-4261-8c25-5094a9ca4625 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:29:35.551002 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4786d982-8067-4261-8c25-5094a9ca4625 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:35.551478 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4786d982-8067-4261-8c25-5094a9ca4625 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:35.551909 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4786d982-8067-4261-8c25-5094a9ca4625 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:35.562398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-22c8f0fa-c0c6-4921-9c74-d46e22b65687 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 204 len: 0 microversion: 2.1 time: 0.406806 Oct 24 13:29:35.563992 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 285/572] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:29:35 2022] DELETE /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:29:35.573733 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5ed02a45-e4b4-40e3-af70-6cca46bad761 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:35.574635 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5ed02a45-e4b4-40e3-af70-6cca46bad761 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:35.588189 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5ed02a45-e4b4-40e3-af70-6cca46bad761 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:35.588779 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5ed02a45-e4b4-40e3-af70-6cca46bad761 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:35.589283 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5ed02a45-e4b4-40e3-af70-6cca46bad761 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:35.590063 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5ed02a45-e4b4-40e3-af70-6cca46bad761 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:35.590656 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5ed02a45-e4b4-40e3-af70-6cca46bad761 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:35.591147 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5ed02a45-e4b4-40e3-af70-6cca46bad761 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:35.618420 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-4786d982-8067-4261-8c25-5094a9ca4625 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Going to try to stop instance {{(pid=119145) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 13:29:35.725497 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5ed02a45-e4b4-40e3-af70-6cca46bad761 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:35.734926 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5ed02a45-e4b4-40e3-af70-6cca46bad761 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1502 microversion: 2.1 time: 0.165873 Oct 24 13:29:35.735457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 286/573] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:35 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:35.793819 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-4786d982-8067-4261-8c25-5094a9ca4625 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "POST /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa/action" status: 202 len: 0 microversion: 2.1 time: 0.252614 Oct 24 13:29:35.794607 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 288/574] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 24 13:29:35 2022] POST /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 13:29:35.803192 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-926cb523-fa3b-4c68-9fc7-24dba7df9874 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:35.803799 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-926cb523-fa3b-4c68-9fc7-24dba7df9874 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:35.809876 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-926cb523-fa3b-4c68-9fc7-24dba7df9874 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:35.810347 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-926cb523-fa3b-4c68-9fc7-24dba7df9874 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:35.810770 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-926cb523-fa3b-4c68-9fc7-24dba7df9874 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:35.811438 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-926cb523-fa3b-4c68-9fc7-24dba7df9874 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:35.811875 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-926cb523-fa3b-4c68-9fc7-24dba7df9874 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:35.812304 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-926cb523-fa3b-4c68-9fc7-24dba7df9874 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:35.943279 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-926cb523-fa3b-4c68-9fc7-24dba7df9874 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:35.951592 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-926cb523-fa3b-4c68-9fc7-24dba7df9874 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.152228 Oct 24 13:29:35.952146 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 287/575] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:35 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:36.566475 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-387ddf62-5d2a-4d1b-bfd1-90a2d4754da8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:36.567677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-387ddf62-5d2a-4d1b-bfd1-90a2d4754da8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:36.574848 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-387ddf62-5d2a-4d1b-bfd1-90a2d4754da8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:36.575350 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-387ddf62-5d2a-4d1b-bfd1-90a2d4754da8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:36.576062 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-387ddf62-5d2a-4d1b-bfd1-90a2d4754da8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:36.576777 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-387ddf62-5d2a-4d1b-bfd1-90a2d4754da8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:36.577305 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-387ddf62-5d2a-4d1b-bfd1-90a2d4754da8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:36.577639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-387ddf62-5d2a-4d1b-bfd1-90a2d4754da8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:36.717144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-387ddf62-5d2a-4d1b-bfd1-90a2d4754da8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:36.721152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-387ddf62-5d2a-4d1b-bfd1-90a2d4754da8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:36.722574 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-387ddf62-5d2a-4d1b-bfd1-90a2d4754da8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:36.723721 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-387ddf62-5d2a-4d1b-bfd1-90a2d4754da8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.162423 Oct 24 13:29:36.724589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 289/576] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:36 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:36.758620 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-d3758fea-22ec-4f09-af44-33af670b4f62 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:36.759231 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-d3758fea-22ec-4f09-af44-33af670b4f62 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:36.765587 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d3758fea-22ec-4f09-af44-33af670b4f62 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:36.766061 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d3758fea-22ec-4f09-af44-33af670b4f62 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:36.766486 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d3758fea-22ec-4f09-af44-33af670b4f62 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:36.767156 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d3758fea-22ec-4f09-af44-33af670b4f62 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:36.767597 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d3758fea-22ec-4f09-af44-33af670b4f62 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:36.768006 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d3758fea-22ec-4f09-af44-33af670b4f62 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:36.897675 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-d3758fea-22ec-4f09-af44-33af670b4f62 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:36.905222 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-d3758fea-22ec-4f09-af44-33af670b4f62 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1502 microversion: 2.1 time: 0.150420 Oct 24 13:29:36.905787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 288/577] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:36 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:36.975894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a7369f3c-636e-47a4-8476-a05efa35e489 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:36.976513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a7369f3c-636e-47a4-8476-a05efa35e489 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:36.982380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a7369f3c-636e-47a4-8476-a05efa35e489 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:36.982847 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a7369f3c-636e-47a4-8476-a05efa35e489 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:36.983270 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a7369f3c-636e-47a4-8476-a05efa35e489 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:36.983934 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a7369f3c-636e-47a4-8476-a05efa35e489 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:36.985012 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a7369f3c-636e-47a4-8476-a05efa35e489 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:36.985427 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a7369f3c-636e-47a4-8476-a05efa35e489 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:37.112817 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a7369f3c-636e-47a4-8476-a05efa35e489 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:37.123161 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a7369f3c-636e-47a4-8476-a05efa35e489 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.151000 Oct 24 13:29:37.127395 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 290/578] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:36 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:37.750775 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-61d59d7f-a559-441d-8734-25c17e29b952 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:37.751491 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-61d59d7f-a559-441d-8734-25c17e29b952 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:37.757373 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-61d59d7f-a559-441d-8734-25c17e29b952 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:37.757845 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-61d59d7f-a559-441d-8734-25c17e29b952 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:37.758266 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-61d59d7f-a559-441d-8734-25c17e29b952 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:37.758937 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-61d59d7f-a559-441d-8734-25c17e29b952 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:37.759498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-61d59d7f-a559-441d-8734-25c17e29b952 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:37.759777 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-61d59d7f-a559-441d-8734-25c17e29b952 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:37.890376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-61d59d7f-a559-441d-8734-25c17e29b952 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:37.899151 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-61d59d7f-a559-441d-8734-25c17e29b952 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:37.901053 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-61d59d7f-a559-441d-8734-25c17e29b952 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:37.902094 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-61d59d7f-a559-441d-8734-25c17e29b952 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.155708 Oct 24 13:29:37.902726 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 289/579] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:37 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:37.928313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-1317c837-669b-43a6-b1c5-19829a5cbe39 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:37.929016 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-1317c837-669b-43a6-b1c5-19829a5cbe39 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:37.935522 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1317c837-669b-43a6-b1c5-19829a5cbe39 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:37.936001 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1317c837-669b-43a6-b1c5-19829a5cbe39 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:37.936456 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1317c837-669b-43a6-b1c5-19829a5cbe39 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:37.937145 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1317c837-669b-43a6-b1c5-19829a5cbe39 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:37.938128 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1317c837-669b-43a6-b1c5-19829a5cbe39 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:37.938543 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1317c837-669b-43a6-b1c5-19829a5cbe39 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:38.146467 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3085e38b-4808-4894-ac08-254a1cd692c4 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:38.147391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-3085e38b-4808-4894-ac08-254a1cd692c4 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:38.158142 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3085e38b-4808-4894-ac08-254a1cd692c4 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:38.158700 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3085e38b-4808-4894-ac08-254a1cd692c4 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:38.159429 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3085e38b-4808-4894-ac08-254a1cd692c4 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:38.160625 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3085e38b-4808-4894-ac08-254a1cd692c4 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:38.161270 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3085e38b-4808-4894-ac08-254a1cd692c4 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:38.161702 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3085e38b-4808-4894-ac08-254a1cd692c4 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:38.308058 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3085e38b-4808-4894-ac08-254a1cd692c4 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:38.317766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3085e38b-4808-4894-ac08-254a1cd692c4 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.174563 Oct 24 13:29:38.326305 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 290/580] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:38 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:38.378915 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1317c837-669b-43a6-b1c5-19829a5cbe39 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:38.386837 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-1317c837-669b-43a6-b1c5-19829a5cbe39 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1502 microversion: 2.1 time: 0.462597 Oct 24 13:29:38.387405 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 291/581] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:37 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1502 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:38.846662 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-1b0b0ffb-073e-4cd5-bc83-cb55e0100b2d req-ec863163-2a4c-4ce3-8b3f-02518dc139ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc85d13-0b95-4517-a112-85b1891de1d1", "name": "network-vif-deleted", "tag": "3a6ca3be-d5e0-4632-93da-954f72814543"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:29:38.856695 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-1b0b0ffb-073e-4cd5-bc83-cb55e0100b2d req-ec863163-2a4c-4ce3-8b3f-02518dc139ca service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:38.857479 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-1b0b0ffb-073e-4cd5-bc83-cb55e0100b2d req-ec863163-2a4c-4ce3-8b3f-02518dc139ca service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:38.857683 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-1b0b0ffb-073e-4cd5-bc83-cb55e0100b2d req-ec863163-2a4c-4ce3-8b3f-02518dc139ca service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:38.868535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-1b0b0ffb-073e-4cd5-bc83-cb55e0100b2d req-ec863163-2a4c-4ce3-8b3f-02518dc139ca service nova] Creating event network-vif-deleted:3a6ca3be-d5e0-4632-93da-954f72814543 for instance 1dc85d13-0b95-4517-a112-85b1891de1d1 on hv-cinder-86249 Oct 24 13:29:38.873189 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-1b0b0ffb-073e-4cd5-bc83-cb55e0100b2d req-ec863163-2a4c-4ce3-8b3f-02518dc139ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031117 Oct 24 13:29:38.873766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 291/582] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:29:38.928815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-4d74f48e-4e65-4d2f-a67b-66c0d6132da3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:38.929417 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-4d74f48e-4e65-4d2f-a67b-66c0d6132da3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:38.941301 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4d74f48e-4e65-4d2f-a67b-66c0d6132da3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:38.943096 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4d74f48e-4e65-4d2f-a67b-66c0d6132da3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:38.943950 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4d74f48e-4e65-4d2f-a67b-66c0d6132da3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:38.944922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4d74f48e-4e65-4d2f-a67b-66c0d6132da3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:38.945528 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4d74f48e-4e65-4d2f-a67b-66c0d6132da3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:38.946157 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4d74f48e-4e65-4d2f-a67b-66c0d6132da3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:39.082898 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-4d74f48e-4e65-4d2f-a67b-66c0d6132da3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:39.093405 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-4d74f48e-4e65-4d2f-a67b-66c0d6132da3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:39.095433 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-4d74f48e-4e65-4d2f-a67b-66c0d6132da3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:39.096680 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-4d74f48e-4e65-4d2f-a67b-66c0d6132da3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.172287 Oct 24 13:29:39.097270 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 292/583] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:38 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:39.341679 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b44c50b1-f258-4ef9-8912-0c9f92fe1a35 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:39.342360 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b44c50b1-f258-4ef9-8912-0c9f92fe1a35 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:39.348703 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b44c50b1-f258-4ef9-8912-0c9f92fe1a35 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:39.349733 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b44c50b1-f258-4ef9-8912-0c9f92fe1a35 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:39.350165 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b44c50b1-f258-4ef9-8912-0c9f92fe1a35 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:39.351244 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b44c50b1-f258-4ef9-8912-0c9f92fe1a35 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:39.351691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b44c50b1-f258-4ef9-8912-0c9f92fe1a35 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:39.352110 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b44c50b1-f258-4ef9-8912-0c9f92fe1a35 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:39.410138 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c1f42132-de69-445c-83a1-34389afa5996 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:39.410740 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-c1f42132-de69-445c-83a1-34389afa5996 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:39.416999 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c1f42132-de69-445c-83a1-34389afa5996 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:39.425415 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c1f42132-de69-445c-83a1-34389afa5996 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:39.425415 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c1f42132-de69-445c-83a1-34389afa5996 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:39.425415 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c1f42132-de69-445c-83a1-34389afa5996 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:39.425415 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c1f42132-de69-445c-83a1-34389afa5996 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:39.425952 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c1f42132-de69-445c-83a1-34389afa5996 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:39.460993 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c1f42132-de69-445c-83a1-34389afa5996 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:39.461532 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c1f42132-de69-445c-83a1-34389afa5996 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:39.463123 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c1f42132-de69-445c-83a1-34389afa5996 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:39.463123 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.objects.instance [None req-c1f42132-de69-445c-83a1-34389afa5996 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lazy-loading 'fault' on Instance uuid 1dc85d13-0b95-4517-a112-85b1891de1d1 {{(pid=119145) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:29:39.492744 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b44c50b1-f258-4ef9-8912-0c9f92fe1a35 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:39.502624 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b44c50b1-f258-4ef9-8912-0c9f92fe1a35 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.164904 Oct 24 13:29:39.502624 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 292/584] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:39 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:39.511259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c1f42132-de69-445c-83a1-34389afa5996 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb837dc77134d96be67f955683b2d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10316acf2adf4f34a63a08f0e60b2548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:39.519966 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-c1f42132-de69-445c-83a1-34389afa5996 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 200 len: 1303 microversion: 2.1 time: 0.113598 Oct 24 13:29:39.520551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 293/585] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:39 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 1303 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:40.123112 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f7adf0ce-c783-4d6b-8e6b-5a1800c48ca3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:40.123842 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f7adf0ce-c783-4d6b-8e6b-5a1800c48ca3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:40.130719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f7adf0ce-c783-4d6b-8e6b-5a1800c48ca3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:40.131165 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f7adf0ce-c783-4d6b-8e6b-5a1800c48ca3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:40.131591 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f7adf0ce-c783-4d6b-8e6b-5a1800c48ca3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:40.132251 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f7adf0ce-c783-4d6b-8e6b-5a1800c48ca3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:40.132718 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f7adf0ce-c783-4d6b-8e6b-5a1800c48ca3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:40.133128 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f7adf0ce-c783-4d6b-8e6b-5a1800c48ca3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:40.267576 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f7adf0ce-c783-4d6b-8e6b-5a1800c48ca3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:40.275596 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f7adf0ce-c783-4d6b-8e6b-5a1800c48ca3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:40.277151 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f7adf0ce-c783-4d6b-8e6b-5a1800c48ca3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:40.282890 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f7adf0ce-c783-4d6b-8e6b-5a1800c48ca3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.159405 Oct 24 13:29:40.282890 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 293/586] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:40 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:40.526289 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-05f05133-01a4-43e1-9b0c-97365ab5330a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:40.526892 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-05f05133-01a4-43e1-9b0c-97365ab5330a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:40.533222 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-05f05133-01a4-43e1-9b0c-97365ab5330a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:40.533687 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-05f05133-01a4-43e1-9b0c-97365ab5330a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:40.534111 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-05f05133-01a4-43e1-9b0c-97365ab5330a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:40.534773 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-05f05133-01a4-43e1-9b0c-97365ab5330a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:40.535212 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-05f05133-01a4-43e1-9b0c-97365ab5330a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:40.535619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-05f05133-01a4-43e1-9b0c-97365ab5330a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:40.538411 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:40.543437 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bbf6769b-93bf-4a7b-b0c3-50ec2aa11f96 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:40.544100 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bbf6769b-93bf-4a7b-b0c3-50ec2aa11f96 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] [instance: 1dc85d13-0b95-4517-a112-85b1891de1d1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:40.551271 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bbf6769b-93bf-4a7b-b0c3-50ec2aa11f96 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:40.553004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bbf6769b-93bf-4a7b-b0c3-50ec2aa11f96 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:40.553004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bbf6769b-93bf-4a7b-b0c3-50ec2aa11f96 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:40.553004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bbf6769b-93bf-4a7b-b0c3-50ec2aa11f96 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:40.553623 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bbf6769b-93bf-4a7b-b0c3-50ec2aa11f96 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:40.554046 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bbf6769b-93bf-4a7b-b0c3-50ec2aa11f96 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:40.568013 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-bbf6769b-93bf-4a7b-b0c3-50ec2aa11f96 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] HTTP exception thrown: Instance 1dc85d13-0b95-4517-a112-85b1891de1d1 could not be found. Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bbf6769b-93bf-4a7b-b0c3-50ec2aa11f96 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Request method failure captured: Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 HTTP/1.1 Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpLsY2LzNAyLeeFfV4suMlswFGKuKZV1g1Ey7-g8PFw2jYcog8k0-mL5LmWbxbkUHsL3UuFZhe9gYSyNURl8FW8ip2tjunqrHf2jAkYeVkh38QVozt_zFswllitgOClRgGhJL2OGtjwPUSEncAFPyaBO4mJKIWecUCllkkCYNaO1ajw Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 10316acf2adf4f34a63a08f0e60b2548 Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-VolumesActionsTest-1088026127 Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:29:40.569680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:29:40.571472 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_10316acf2adf4f34a63a08f0e60b2548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/10316acf2adf4f34a63a08f0e60b2548"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/10316acf2adf4f34a63a08f0e60b2548"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/10316acf2adf4f34a63a08f0e60b2548"}]}] Oct 24 13:29:40.571472 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-VolumesActionsTest-1088026127 Oct 24 13:29:40.571472 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 10316acf2adf4f34a63a08f0e60b2548 Oct 24 13:29:40.571472 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-VolumesActionsTest-1088026127 Oct 24 13:29:40.571472 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-VolumesActionsTest-1088026127-project Oct 24 13:29:40.571472 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:29:40.571472 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:29:40.571472 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: feb837dc77134d96be67f955683b2d7d Oct 24 13:29:40.571472 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-VolumesActionsTest-1088026127-project Oct 24 13:29:40.571472 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:29:40.571472 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Instance 1dc85d13-0b95-4517-a112-85b1891de1d1 could not be found. Oct 24 13:29:40.571472 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': '1dc85d13-0b95-4517-a112-85b1891de1d1'} Oct 24 13:29:40.572403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:29:40.572403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:29:40.572403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:29:40.572403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:29:40.572403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:29:40.572403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:29:40.572403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:29:40.572403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:29:40.572403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:29:40.572403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:29:40.572403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dc85d13-0b95-4517-a112-85b1891de1d1 could not be found. Oct 24 13:29:40.572403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:29:40.572403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:29:40.572403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:29:40.572403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:29:40.572403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:29:40.572403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:29:40.572403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:29:40.572403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:29:40.572403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:29:40.573615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:29:40.573615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:29:40.573615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:29:40.573615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:29:40.573615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:29:40.573615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:29:40.573615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:29:40.573615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dc85d13-0b95-4517-a112-85b1891de1d1 could not be found. Oct 24 13:29:40.573615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:29:40.573615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:29:40.573615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:29:40.573615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:29:40.573615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:29:40.573615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:29:40.573615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:29:40.573615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:29:40.573615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dc85d13-0b95-4517-a112-85b1891de1d1 could not be found. Oct 24 13:29:40.573615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:29:40.574781 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bbf6769b-93bf-4a7b-b0c3-50ec2aa11f96 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] Returning 404 to user: Instance 1dc85d13-0b95-4517-a112-85b1891de1d1 could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:29:40.574781 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-bbf6769b-93bf-4a7b-b0c3-50ec2aa11f96 tempest-VolumesActionsTest-1088026127 tempest-VolumesActionsTest-1088026127-project] 10.222.0.48 "GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1" status: 404 len: 111 microversion: 2.1 time: 0.031856 Oct 24 13:29:40.574933 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 294/587] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:40 2022] GET /compute/v2.1/servers/1dc85d13-0b95-4517-a112-85b1891de1d1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:29:40.669714 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-05f05133-01a4-43e1-9b0c-97365ab5330a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:40.678653 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-05f05133-01a4-43e1-9b0c-97365ab5330a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.156163 Oct 24 13:29:40.679247 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 294/588] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:40 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:41.304428 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-97e98675-015e-47ed-a3e4-b6f24b46ea1b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:41.305043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-97e98675-015e-47ed-a3e4-b6f24b46ea1b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:41.311633 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-97e98675-015e-47ed-a3e4-b6f24b46ea1b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:41.312512 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-97e98675-015e-47ed-a3e4-b6f24b46ea1b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:41.312603 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-97e98675-015e-47ed-a3e4-b6f24b46ea1b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:41.313249 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-97e98675-015e-47ed-a3e4-b6f24b46ea1b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:41.313777 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-97e98675-015e-47ed-a3e4-b6f24b46ea1b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:41.315506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-97e98675-015e-47ed-a3e4-b6f24b46ea1b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:41.319082 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:41.450026 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-97e98675-015e-47ed-a3e4-b6f24b46ea1b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:41.458704 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-97e98675-015e-47ed-a3e4-b6f24b46ea1b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:41.460117 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-97e98675-015e-47ed-a3e4-b6f24b46ea1b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:41.461280 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-97e98675-015e-47ed-a3e4-b6f24b46ea1b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.160979 Oct 24 13:29:41.461845 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 295/589] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:41 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:41.701944 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-95f89b6a-210f-494f-a9c1-8570cbcdd7ec tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:41.702581 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-95f89b6a-210f-494f-a9c1-8570cbcdd7ec tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:41.709546 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-95f89b6a-210f-494f-a9c1-8570cbcdd7ec tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:41.710215 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-95f89b6a-210f-494f-a9c1-8570cbcdd7ec tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:41.710650 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-95f89b6a-210f-494f-a9c1-8570cbcdd7ec tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:41.711330 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-95f89b6a-210f-494f-a9c1-8570cbcdd7ec tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:41.711783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-95f89b6a-210f-494f-a9c1-8570cbcdd7ec tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:41.712199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-95f89b6a-210f-494f-a9c1-8570cbcdd7ec tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:41.850377 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-95f89b6a-210f-494f-a9c1-8570cbcdd7ec tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:41.858674 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-95f89b6a-210f-494f-a9c1-8570cbcdd7ec tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.160771 Oct 24 13:29:41.859788 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 295/590] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:41 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:42.487507 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b3266128-3e4b-494b-a04c-17fcb7beae00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:42.488109 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b3266128-3e4b-494b-a04c-17fcb7beae00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:42.494861 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b3266128-3e4b-494b-a04c-17fcb7beae00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:42.495329 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b3266128-3e4b-494b-a04c-17fcb7beae00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:42.495750 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b3266128-3e4b-494b-a04c-17fcb7beae00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:42.496450 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b3266128-3e4b-494b-a04c-17fcb7beae00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:42.496894 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b3266128-3e4b-494b-a04c-17fcb7beae00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:42.497312 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b3266128-3e4b-494b-a04c-17fcb7beae00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:42.626479 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b3266128-3e4b-494b-a04c-17fcb7beae00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:42.634780 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b3266128-3e4b-494b-a04c-17fcb7beae00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:42.636226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b3266128-3e4b-494b-a04c-17fcb7beae00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:42.637477 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b3266128-3e4b-494b-a04c-17fcb7beae00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.154243 Oct 24 13:29:42.638035 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 296/591] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:42 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:42.884780 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-149fe5a4-6811-46f3-9265-592d317b2012 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:42.885658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-149fe5a4-6811-46f3-9265-592d317b2012 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:42.893368 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-149fe5a4-6811-46f3-9265-592d317b2012 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:42.893885 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-149fe5a4-6811-46f3-9265-592d317b2012 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:42.894297 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-149fe5a4-6811-46f3-9265-592d317b2012 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:42.894998 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-149fe5a4-6811-46f3-9265-592d317b2012 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:42.895451 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-149fe5a4-6811-46f3-9265-592d317b2012 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:42.895881 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-149fe5a4-6811-46f3-9265-592d317b2012 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:43.022961 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-149fe5a4-6811-46f3-9265-592d317b2012 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:43.031606 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-149fe5a4-6811-46f3-9265-592d317b2012 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.151066 Oct 24 13:29:43.032157 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 296/592] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:42 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:43.662738 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-64d6b438-b25a-43f7-9f2f-e1bde74326c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:43.663343 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-64d6b438-b25a-43f7-9f2f-e1bde74326c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:43.669763 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-64d6b438-b25a-43f7-9f2f-e1bde74326c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:43.670236 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-64d6b438-b25a-43f7-9f2f-e1bde74326c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:43.670659 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-64d6b438-b25a-43f7-9f2f-e1bde74326c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:43.671332 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-64d6b438-b25a-43f7-9f2f-e1bde74326c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:43.671773 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-64d6b438-b25a-43f7-9f2f-e1bde74326c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:43.672182 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-64d6b438-b25a-43f7-9f2f-e1bde74326c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:43.800346 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-64d6b438-b25a-43f7-9f2f-e1bde74326c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:43.808287 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-64d6b438-b25a-43f7-9f2f-e1bde74326c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:43.809706 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-64d6b438-b25a-43f7-9f2f-e1bde74326c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:43.810842 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-64d6b438-b25a-43f7-9f2f-e1bde74326c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.151965 Oct 24 13:29:43.811393 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 297/593] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:43 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:44.055419 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e2373dfe-cebe-4b85-9855-bfe57fe30a53 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:44.055952 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e2373dfe-cebe-4b85-9855-bfe57fe30a53 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:44.058243 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=84 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:44.063311 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e2373dfe-cebe-4b85-9855-bfe57fe30a53 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:44.063776 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e2373dfe-cebe-4b85-9855-bfe57fe30a53 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:44.064197 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e2373dfe-cebe-4b85-9855-bfe57fe30a53 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:44.064891 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e2373dfe-cebe-4b85-9855-bfe57fe30a53 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:44.065331 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e2373dfe-cebe-4b85-9855-bfe57fe30a53 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:44.065740 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e2373dfe-cebe-4b85-9855-bfe57fe30a53 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:44.199759 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e2373dfe-cebe-4b85-9855-bfe57fe30a53 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:44.208129 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e2373dfe-cebe-4b85-9855-bfe57fe30a53 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.156567 Oct 24 13:29:44.208715 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 297/594] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:44 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:44.836902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b2c02997-de40-4fc9-be0f-474c1c61fa93 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:44.837515 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b2c02997-de40-4fc9-be0f-474c1c61fa93 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:44.844263 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2c02997-de40-4fc9-be0f-474c1c61fa93 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:44.844765 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2c02997-de40-4fc9-be0f-474c1c61fa93 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:44.845192 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2c02997-de40-4fc9-be0f-474c1c61fa93 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:44.845873 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2c02997-de40-4fc9-be0f-474c1c61fa93 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:44.846320 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2c02997-de40-4fc9-be0f-474c1c61fa93 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:44.846729 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2c02997-de40-4fc9-be0f-474c1c61fa93 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:44.970780 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b2c02997-de40-4fc9-be0f-474c1c61fa93 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:44.978733 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b2c02997-de40-4fc9-be0f-474c1c61fa93 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:44.980177 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b2c02997-de40-4fc9-be0f-474c1c61fa93 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:44.981394 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b2c02997-de40-4fc9-be0f-474c1c61fa93 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.148429 Oct 24 13:29:44.981963 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 298/595] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:44 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:45.230809 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-3dee00b1-0da7-489d-9774-44b16594d1c2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:45.231411 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-3dee00b1-0da7-489d-9774-44b16594d1c2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:45.238370 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3dee00b1-0da7-489d-9774-44b16594d1c2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:45.238839 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3dee00b1-0da7-489d-9774-44b16594d1c2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:45.239261 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3dee00b1-0da7-489d-9774-44b16594d1c2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:45.239935 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3dee00b1-0da7-489d-9774-44b16594d1c2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:45.240399 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3dee00b1-0da7-489d-9774-44b16594d1c2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:45.240809 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3dee00b1-0da7-489d-9774-44b16594d1c2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:45.369671 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-3dee00b1-0da7-489d-9774-44b16594d1c2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:45.377701 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-3dee00b1-0da7-489d-9774-44b16594d1c2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.150707 Oct 24 13:29:45.378255 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 298/596] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:45 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:46.006966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-85758717-8255-4cdc-a0e2-9627cc2e0029 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:46.007563 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-85758717-8255-4cdc-a0e2-9627cc2e0029 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:46.014215 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-85758717-8255-4cdc-a0e2-9627cc2e0029 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:46.014685 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-85758717-8255-4cdc-a0e2-9627cc2e0029 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:46.015103 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-85758717-8255-4cdc-a0e2-9627cc2e0029 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:46.015770 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-85758717-8255-4cdc-a0e2-9627cc2e0029 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:46.016214 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-85758717-8255-4cdc-a0e2-9627cc2e0029 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:46.016649 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-85758717-8255-4cdc-a0e2-9627cc2e0029 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:46.360354 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-85758717-8255-4cdc-a0e2-9627cc2e0029 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:46.370611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-85758717-8255-4cdc-a0e2-9627cc2e0029 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:46.372725 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-85758717-8255-4cdc-a0e2-9627cc2e0029 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:46.374698 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-85758717-8255-4cdc-a0e2-9627cc2e0029 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.371403 Oct 24 13:29:46.375643 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 299/597] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:46 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:46.400653 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f354f698-5c75-4300-b74e-cf0d4cfacdb8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:46.401314 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f354f698-5c75-4300-b74e-cf0d4cfacdb8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:46.408324 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f354f698-5c75-4300-b74e-cf0d4cfacdb8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:46.408802 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f354f698-5c75-4300-b74e-cf0d4cfacdb8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:46.409229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f354f698-5c75-4300-b74e-cf0d4cfacdb8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:46.409905 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f354f698-5c75-4300-b74e-cf0d4cfacdb8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:46.410349 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f354f698-5c75-4300-b74e-cf0d4cfacdb8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:46.410764 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f354f698-5c75-4300-b74e-cf0d4cfacdb8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:46.537248 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f354f698-5c75-4300-b74e-cf0d4cfacdb8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:46.545659 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f354f698-5c75-4300-b74e-cf0d4cfacdb8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.148709 Oct 24 13:29:46.546249 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 299/598] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:46 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:47.400570 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5e47e7bd-256d-4e57-819a-2c144c9bb8da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:47.401183 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5e47e7bd-256d-4e57-819a-2c144c9bb8da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:47.407862 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e47e7bd-256d-4e57-819a-2c144c9bb8da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:47.409332 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e47e7bd-256d-4e57-819a-2c144c9bb8da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:47.410093 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e47e7bd-256d-4e57-819a-2c144c9bb8da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:47.410797 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e47e7bd-256d-4e57-819a-2c144c9bb8da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:47.411245 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e47e7bd-256d-4e57-819a-2c144c9bb8da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:47.411661 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e47e7bd-256d-4e57-819a-2c144c9bb8da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:47.539247 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5e47e7bd-256d-4e57-819a-2c144c9bb8da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:47.547759 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5e47e7bd-256d-4e57-819a-2c144c9bb8da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:47.549216 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5e47e7bd-256d-4e57-819a-2c144c9bb8da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:47.550363 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5e47e7bd-256d-4e57-819a-2c144c9bb8da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.153728 Oct 24 13:29:47.550911 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 300/599] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:47 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:47.568379 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f2729790-61db-4547-8c4d-da5c28c44360 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:47.568980 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f2729790-61db-4547-8c4d-da5c28c44360 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:47.575536 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f2729790-61db-4547-8c4d-da5c28c44360 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:47.576003 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f2729790-61db-4547-8c4d-da5c28c44360 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:47.576454 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f2729790-61db-4547-8c4d-da5c28c44360 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:47.577120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f2729790-61db-4547-8c4d-da5c28c44360 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:47.577563 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f2729790-61db-4547-8c4d-da5c28c44360 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:47.577970 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f2729790-61db-4547-8c4d-da5c28c44360 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:47.707259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f2729790-61db-4547-8c4d-da5c28c44360 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:47.715308 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f2729790-61db-4547-8c4d-da5c28c44360 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.150800 Oct 24 13:29:47.715866 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 300/600] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:47 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:48.576171 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-aa9ab239-124a-498b-9d94-610f53ea0017 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:48.576806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-aa9ab239-124a-498b-9d94-610f53ea0017 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:48.583877 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-aa9ab239-124a-498b-9d94-610f53ea0017 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:48.584400 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-aa9ab239-124a-498b-9d94-610f53ea0017 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:48.584833 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-aa9ab239-124a-498b-9d94-610f53ea0017 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:48.585546 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-aa9ab239-124a-498b-9d94-610f53ea0017 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:48.586017 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-aa9ab239-124a-498b-9d94-610f53ea0017 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:48.586436 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-aa9ab239-124a-498b-9d94-610f53ea0017 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:48.712839 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-aa9ab239-124a-498b-9d94-610f53ea0017 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:48.721313 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-aa9ab239-124a-498b-9d94-610f53ea0017 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:48.722737 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-aa9ab239-124a-498b-9d94-610f53ea0017 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:48.729640 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-aa9ab239-124a-498b-9d94-610f53ea0017 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.151965 Oct 24 13:29:48.729640 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 301/601] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:48 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:48.738733 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-2731217e-4180-43d4-9132-0f6ceb756163 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:48.739494 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-2731217e-4180-43d4-9132-0f6ceb756163 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:48.745931 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2731217e-4180-43d4-9132-0f6ceb756163 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:48.746401 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2731217e-4180-43d4-9132-0f6ceb756163 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:48.746829 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2731217e-4180-43d4-9132-0f6ceb756163 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:48.747503 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2731217e-4180-43d4-9132-0f6ceb756163 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:48.747949 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2731217e-4180-43d4-9132-0f6ceb756163 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:48.748387 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2731217e-4180-43d4-9132-0f6ceb756163 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:48.873818 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-2731217e-4180-43d4-9132-0f6ceb756163 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:48.882085 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-2731217e-4180-43d4-9132-0f6ceb756163 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.147161 Oct 24 13:29:48.882642 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 301/602] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:48 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:49.753097 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-6d0f50e1-9586-4bd5-a7dd-29c3ea3ee0a1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:49.753635 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-6d0f50e1-9586-4bd5-a7dd-29c3ea3ee0a1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:49.759998 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6d0f50e1-9586-4bd5-a7dd-29c3ea3ee0a1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:49.760511 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6d0f50e1-9586-4bd5-a7dd-29c3ea3ee0a1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:49.760944 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6d0f50e1-9586-4bd5-a7dd-29c3ea3ee0a1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:49.761631 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6d0f50e1-9586-4bd5-a7dd-29c3ea3ee0a1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:49.762109 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6d0f50e1-9586-4bd5-a7dd-29c3ea3ee0a1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:49.762536 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6d0f50e1-9586-4bd5-a7dd-29c3ea3ee0a1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:49.886522 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6d0f50e1-9586-4bd5-a7dd-29c3ea3ee0a1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:49.894609 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6d0f50e1-9586-4bd5-a7dd-29c3ea3ee0a1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:49.896056 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6d0f50e1-9586-4bd5-a7dd-29c3ea3ee0a1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:49.897223 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-6d0f50e1-9586-4bd5-a7dd-29c3ea3ee0a1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.148134 Oct 24 13:29:49.897775 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 302/603] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:49 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:49.905267 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-72262189-8ec6-4bd7-ac67-e4e8bb57a6b2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:49.906423 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-72262189-8ec6-4bd7-ac67-e4e8bb57a6b2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:49.912730 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-72262189-8ec6-4bd7-ac67-e4e8bb57a6b2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:49.913200 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-72262189-8ec6-4bd7-ac67-e4e8bb57a6b2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:49.914640 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-72262189-8ec6-4bd7-ac67-e4e8bb57a6b2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:49.915351 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-72262189-8ec6-4bd7-ac67-e4e8bb57a6b2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:49.915808 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-72262189-8ec6-4bd7-ac67-e4e8bb57a6b2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:49.916228 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-72262189-8ec6-4bd7-ac67-e4e8bb57a6b2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:50.042316 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-72262189-8ec6-4bd7-ac67-e4e8bb57a6b2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:50.051030 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-72262189-8ec6-4bd7-ac67-e4e8bb57a6b2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.149609 Oct 24 13:29:50.051594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 302/604] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:49 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:50.923654 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-40d46c31-3103-4eb6-8707-3022354a7480 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:50.924283 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-40d46c31-3103-4eb6-8707-3022354a7480 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:50.930811 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-40d46c31-3103-4eb6-8707-3022354a7480 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:50.931291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-40d46c31-3103-4eb6-8707-3022354a7480 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:50.931723 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-40d46c31-3103-4eb6-8707-3022354a7480 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:50.932450 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-40d46c31-3103-4eb6-8707-3022354a7480 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:50.932903 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-40d46c31-3103-4eb6-8707-3022354a7480 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:50.933326 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-40d46c31-3103-4eb6-8707-3022354a7480 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:51.066909 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-40d46c31-3103-4eb6-8707-3022354a7480 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:51.076733 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-40d46c31-3103-4eb6-8707-3022354a7480 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:51.078717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-40d46c31-3103-4eb6-8707-3022354a7480 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:51.080100 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-40d46c31-3103-4eb6-8707-3022354a7480 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.160964 Oct 24 13:29:51.083747 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-101cf45d-6224-4dab-a134-84c90fc66fd8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:51.085840 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-101cf45d-6224-4dab-a134-84c90fc66fd8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:51.096586 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 303/605] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:50 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:51.100973 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-101cf45d-6224-4dab-a134-84c90fc66fd8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:51.101826 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-101cf45d-6224-4dab-a134-84c90fc66fd8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:51.102267 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-101cf45d-6224-4dab-a134-84c90fc66fd8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:51.102978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-101cf45d-6224-4dab-a134-84c90fc66fd8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:51.103471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-101cf45d-6224-4dab-a134-84c90fc66fd8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:51.103888 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-101cf45d-6224-4dab-a134-84c90fc66fd8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:51.242957 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-101cf45d-6224-4dab-a134-84c90fc66fd8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:51.252009 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-101cf45d-6224-4dab-a134-84c90fc66fd8 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.180830 Oct 24 13:29:51.252548 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 303/606] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:51 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:52.107705 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f5614125-64ee-4cc0-b123-153b56bef941 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:52.108677 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f5614125-64ee-4cc0-b123-153b56bef941 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:52.116346 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f5614125-64ee-4cc0-b123-153b56bef941 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:52.116929 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f5614125-64ee-4cc0-b123-153b56bef941 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:52.117366 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f5614125-64ee-4cc0-b123-153b56bef941 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:52.118361 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f5614125-64ee-4cc0-b123-153b56bef941 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:52.118886 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f5614125-64ee-4cc0-b123-153b56bef941 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:52.119527 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f5614125-64ee-4cc0-b123-153b56bef941 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:52.275237 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-953b777c-3139-4fff-842d-a335f7014327 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:52.275842 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-953b777c-3139-4fff-842d-a335f7014327 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:52.286406 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f5614125-64ee-4cc0-b123-153b56bef941 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:52.294851 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-953b777c-3139-4fff-842d-a335f7014327 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:52.295587 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-953b777c-3139-4fff-842d-a335f7014327 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:52.297333 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f5614125-64ee-4cc0-b123-153b56bef941 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:52.297983 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-953b777c-3139-4fff-842d-a335f7014327 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:52.299098 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-953b777c-3139-4fff-842d-a335f7014327 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:52.299713 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-953b777c-3139-4fff-842d-a335f7014327 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:52.300811 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-953b777c-3139-4fff-842d-a335f7014327 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:52.306360 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f5614125-64ee-4cc0-b123-153b56bef941 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:52.310732 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f5614125-64ee-4cc0-b123-153b56bef941 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1742 microversion: 2.20 time: 0.206228 Oct 24 13:29:52.312777 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 304/607] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:52 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1742 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:52.465871 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-953b777c-3139-4fff-842d-a335f7014327 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:52.475241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-953b777c-3139-4fff-842d-a335f7014327 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.204020 Oct 24 13:29:52.475812 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 304/608] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:52 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:53.343446 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f9a9e070-72bf-4766-a6ee-78fd4d24e91b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:53.343446 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f9a9e070-72bf-4766-a6ee-78fd4d24e91b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:53.353745 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:53.355693 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f9a9e070-72bf-4766-a6ee-78fd4d24e91b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:53.356387 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f9a9e070-72bf-4766-a6ee-78fd4d24e91b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:53.357924 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f9a9e070-72bf-4766-a6ee-78fd4d24e91b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:53.359783 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f9a9e070-72bf-4766-a6ee-78fd4d24e91b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:53.360516 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f9a9e070-72bf-4766-a6ee-78fd4d24e91b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:53.361010 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f9a9e070-72bf-4766-a6ee-78fd4d24e91b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:53.499020 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0984b1d7-4ef7-43a3-8355-3f036cb87b62 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:53.499665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0984b1d7-4ef7-43a3-8355-3f036cb87b62 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:53.507047 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0984b1d7-4ef7-43a3-8355-3f036cb87b62 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:53.507768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0984b1d7-4ef7-43a3-8355-3f036cb87b62 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:53.508474 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0984b1d7-4ef7-43a3-8355-3f036cb87b62 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:53.509345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0984b1d7-4ef7-43a3-8355-3f036cb87b62 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:53.509971 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0984b1d7-4ef7-43a3-8355-3f036cb87b62 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:53.510642 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0984b1d7-4ef7-43a3-8355-3f036cb87b62 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:53.563015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f9a9e070-72bf-4766-a6ee-78fd4d24e91b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:53.576091 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f9a9e070-72bf-4766-a6ee-78fd4d24e91b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:53.589485 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f9a9e070-72bf-4766-a6ee-78fd4d24e91b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:53.590849 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f9a9e070-72bf-4766-a6ee-78fd4d24e91b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1742 microversion: 2.20 time: 0.254113 Oct 24 13:29:53.591513 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 305/609] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:53 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1742 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:53.698244 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0984b1d7-4ef7-43a3-8355-3f036cb87b62 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:53.712460 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0984b1d7-4ef7-43a3-8355-3f036cb87b62 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.217074 Oct 24 13:29:53.726865 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 305/610] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:53 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:54.618917 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-4be527fc-e07c-4ac5-980e-2ca3dd72922b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:54.619679 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-4be527fc-e07c-4ac5-980e-2ca3dd72922b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:54.628227 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4be527fc-e07c-4ac5-980e-2ca3dd72922b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:54.628928 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4be527fc-e07c-4ac5-980e-2ca3dd72922b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:54.629658 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4be527fc-e07c-4ac5-980e-2ca3dd72922b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:54.630598 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4be527fc-e07c-4ac5-980e-2ca3dd72922b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:54.631272 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4be527fc-e07c-4ac5-980e-2ca3dd72922b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:54.631893 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4be527fc-e07c-4ac5-980e-2ca3dd72922b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:54.736298 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c1e2fee8-da9a-4017-b945-9de01a78c075 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:54.737194 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-c1e2fee8-da9a-4017-b945-9de01a78c075 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:54.744192 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c1e2fee8-da9a-4017-b945-9de01a78c075 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:54.744799 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c1e2fee8-da9a-4017-b945-9de01a78c075 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:54.745306 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c1e2fee8-da9a-4017-b945-9de01a78c075 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:54.746078 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c1e2fee8-da9a-4017-b945-9de01a78c075 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:54.746635 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c1e2fee8-da9a-4017-b945-9de01a78c075 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:54.747126 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c1e2fee8-da9a-4017-b945-9de01a78c075 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:54.798658 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-4be527fc-e07c-4ac5-980e-2ca3dd72922b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:54.807695 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-4be527fc-e07c-4ac5-980e-2ca3dd72922b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:54.809156 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-4be527fc-e07c-4ac5-980e-2ca3dd72922b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:54.811544 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-4be527fc-e07c-4ac5-980e-2ca3dd72922b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1742 microversion: 2.20 time: 0.197525 Oct 24 13:29:54.812830 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 306/611] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:54 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1742 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:29:54.941046 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c1e2fee8-da9a-4017-b945-9de01a78c075 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:54.955395 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-c1e2fee8-da9a-4017-b945-9de01a78c075 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.217725 Oct 24 13:29:54.956263 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 306/612] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:54 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:55.239341 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-b4dc3a03-e7c0-4473-9f69-4decb6fcf8df req-a283c4bb-d8cb-4a71-b80e-f8fe2899d2be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d04bbb-034d-4cf1-a753-9c4cb48e92bd", "name": "network-vif-plugged", "status": "completed", "tag": "4dfc7079-30d9-488d-9dfc-1df75d250b32"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:29:55.250465 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-b4dc3a03-e7c0-4473-9f69-4decb6fcf8df req-a283c4bb-d8cb-4a71-b80e-f8fe2899d2be service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:55.251340 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-b4dc3a03-e7c0-4473-9f69-4decb6fcf8df req-a283c4bb-d8cb-4a71-b80e-f8fe2899d2be service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:55.251942 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-b4dc3a03-e7c0-4473-9f69-4decb6fcf8df req-a283c4bb-d8cb-4a71-b80e-f8fe2899d2be service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:55.263718 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-b4dc3a03-e7c0-4473-9f69-4decb6fcf8df req-a283c4bb-d8cb-4a71-b80e-f8fe2899d2be service nova] Creating event network-vif-plugged:4dfc7079-30d9-488d-9dfc-1df75d250b32 for instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd on hv-cinder-86249 Oct 24 13:29:55.269575 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-b4dc3a03-e7c0-4473-9f69-4decb6fcf8df req-a283c4bb-d8cb-4a71-b80e-f8fe2899d2be service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033889 Oct 24 13:29:55.270567 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 307/613] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:29:55.839877 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-3807d95a-ed8e-46ed-a846-883f490ad03b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:55.841282 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-3807d95a-ed8e-46ed-a846-883f490ad03b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:55.848884 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3807d95a-ed8e-46ed-a846-883f490ad03b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:55.849656 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3807d95a-ed8e-46ed-a846-883f490ad03b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:55.850339 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3807d95a-ed8e-46ed-a846-883f490ad03b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:55.851264 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3807d95a-ed8e-46ed-a846-883f490ad03b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:55.851926 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3807d95a-ed8e-46ed-a846-883f490ad03b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:55.852587 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3807d95a-ed8e-46ed-a846-883f490ad03b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:55.982304 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1ceb2764-5242-4643-9a4c-75a1a13faf13 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:55.998215 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-1ceb2764-5242-4643-9a4c-75a1a13faf13 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:55.998215 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1ceb2764-5242-4643-9a4c-75a1a13faf13 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:55.998215 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1ceb2764-5242-4643-9a4c-75a1a13faf13 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:55.998215 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1ceb2764-5242-4643-9a4c-75a1a13faf13 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:55.998735 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1ceb2764-5242-4643-9a4c-75a1a13faf13 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:55.998735 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1ceb2764-5242-4643-9a4c-75a1a13faf13 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:55.998735 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1ceb2764-5242-4643-9a4c-75a1a13faf13 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:56.017111 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-3807d95a-ed8e-46ed-a846-883f490ad03b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:56.027152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-3807d95a-ed8e-46ed-a846-883f490ad03b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:56.028941 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-3807d95a-ed8e-46ed-a846-883f490ad03b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:56.029817 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-3807d95a-ed8e-46ed-a846-883f490ad03b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1742 microversion: 2.20 time: 0.194937 Oct 24 13:29:56.032020 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 307/614] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:55 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1742 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:56.162121 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1ceb2764-5242-4643-9a4c-75a1a13faf13 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:56.171076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1ceb2764-5242-4643-9a4c-75a1a13faf13 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.195656 Oct 24 13:29:56.172632 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 308/615] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:55 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:57.059269 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-5ee60852-a780-47c1-9ed0-1e9cbb92504f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:57.059876 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-5ee60852-a780-47c1-9ed0-1e9cbb92504f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:57.066798 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5ee60852-a780-47c1-9ed0-1e9cbb92504f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:57.067279 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5ee60852-a780-47c1-9ed0-1e9cbb92504f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:57.068017 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5ee60852-a780-47c1-9ed0-1e9cbb92504f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:57.068855 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5ee60852-a780-47c1-9ed0-1e9cbb92504f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:57.069301 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5ee60852-a780-47c1-9ed0-1e9cbb92504f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:57.069713 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5ee60852-a780-47c1-9ed0-1e9cbb92504f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:57.198611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ee97ac75-4a49-444a-99d3-bae8a6ade013 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:57.199224 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-ee97ac75-4a49-444a-99d3-bae8a6ade013 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:57.207184 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee97ac75-4a49-444a-99d3-bae8a6ade013 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:57.207975 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee97ac75-4a49-444a-99d3-bae8a6ade013 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:57.208444 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee97ac75-4a49-444a-99d3-bae8a6ade013 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:57.209153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee97ac75-4a49-444a-99d3-bae8a6ade013 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:57.209605 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee97ac75-4a49-444a-99d3-bae8a6ade013 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:57.210021 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee97ac75-4a49-444a-99d3-bae8a6ade013 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:57.214041 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-5ee60852-a780-47c1-9ed0-1e9cbb92504f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:57.223559 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-5ee60852-a780-47c1-9ed0-1e9cbb92504f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:57.225640 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-5ee60852-a780-47c1-9ed0-1e9cbb92504f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:57.227373 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-5ee60852-a780-47c1-9ed0-1e9cbb92504f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1742 microversion: 2.20 time: 0.172130 Oct 24 13:29:57.245204 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 308/616] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:57 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1742 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:57.373951 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ee97ac75-4a49-444a-99d3-bae8a6ade013 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:57.383050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-ee97ac75-4a49-444a-99d3-bae8a6ade013 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.188408 Oct 24 13:29:57.383609 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 309/617] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:57 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:29:58.254793 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-84cda410-21f5-4f7d-88f7-cc74bff68d12 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:58.255550 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-84cda410-21f5-4f7d-88f7-cc74bff68d12 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:58.262458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-84cda410-21f5-4f7d-88f7-cc74bff68d12 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:58.263282 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-84cda410-21f5-4f7d-88f7-cc74bff68d12 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:58.263804 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-84cda410-21f5-4f7d-88f7-cc74bff68d12 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:58.264580 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-84cda410-21f5-4f7d-88f7-cc74bff68d12 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:58.265973 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-84cda410-21f5-4f7d-88f7-cc74bff68d12 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:58.266466 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-84cda410-21f5-4f7d-88f7-cc74bff68d12 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:58.409723 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-40e3bfe3-b39c-48ec-ad8b-6a9d5f0bd36e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:58.411079 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-40e3bfe3-b39c-48ec-ad8b-6a9d5f0bd36e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:58.415363 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-84cda410-21f5-4f7d-88f7-cc74bff68d12 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:58.418465 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-40e3bfe3-b39c-48ec-ad8b-6a9d5f0bd36e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:58.419300 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-40e3bfe3-b39c-48ec-ad8b-6a9d5f0bd36e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:58.419965 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-40e3bfe3-b39c-48ec-ad8b-6a9d5f0bd36e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:58.420891 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-40e3bfe3-b39c-48ec-ad8b-6a9d5f0bd36e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:58.422079 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-40e3bfe3-b39c-48ec-ad8b-6a9d5f0bd36e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:58.422818 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-40e3bfe3-b39c-48ec-ad8b-6a9d5f0bd36e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:58.434434 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-84cda410-21f5-4f7d-88f7-cc74bff68d12 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:58.438590 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-84cda410-21f5-4f7d-88f7-cc74bff68d12 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:58.441796 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-84cda410-21f5-4f7d-88f7-cc74bff68d12 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1742 microversion: 2.20 time: 0.190691 Oct 24 13:29:58.457941 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 309/618] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:58 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1742 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:58.576025 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-40e3bfe3-b39c-48ec-ad8b-6a9d5f0bd36e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:58.587804 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-40e3bfe3-b39c-48ec-ad8b-6a9d5f0bd36e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.184710 Oct 24 13:29:58.588717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 310/619] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:58 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:29:59.476707 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-1ecc0d0e-f87b-4016-bc66-7d1dd1fb5f6c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:59.479365 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-1ecc0d0e-f87b-4016-bc66-7d1dd1fb5f6c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:59.489465 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ecc0d0e-f87b-4016-bc66-7d1dd1fb5f6c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:59.490382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ecc0d0e-f87b-4016-bc66-7d1dd1fb5f6c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:59.491235 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ecc0d0e-f87b-4016-bc66-7d1dd1fb5f6c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:59.493088 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ecc0d0e-f87b-4016-bc66-7d1dd1fb5f6c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:59.493854 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ecc0d0e-f87b-4016-bc66-7d1dd1fb5f6c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:59.494388 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ecc0d0e-f87b-4016-bc66-7d1dd1fb5f6c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:59.613704 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-fa898998-10c9-4985-a92f-f5392020eb1e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:29:59.614464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-fa898998-10c9-4985-a92f-f5392020eb1e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:29:59.623697 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fa898998-10c9-4985-a92f-f5392020eb1e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:59.627359 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fa898998-10c9-4985-a92f-f5392020eb1e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:59.627359 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fa898998-10c9-4985-a92f-f5392020eb1e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:59.627359 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fa898998-10c9-4985-a92f-f5392020eb1e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:29:59.628103 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fa898998-10c9-4985-a92f-f5392020eb1e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:29:59.628634 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fa898998-10c9-4985-a92f-f5392020eb1e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:29:59.705493 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1ecc0d0e-f87b-4016-bc66-7d1dd1fb5f6c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:59.709451 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=100 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:29:59.718571 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1ecc0d0e-f87b-4016-bc66-7d1dd1fb5f6c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:59.720149 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1ecc0d0e-f87b-4016-bc66-7d1dd1fb5f6c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:59.721504 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-1ecc0d0e-f87b-4016-bc66-7d1dd1fb5f6c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1742 microversion: 2.20 time: 0.250192 Oct 24 13:29:59.723335 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 310/620] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:29:59 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1742 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:29:59.820741 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fa898998-10c9-4985-a92f-f5392020eb1e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:29:59.834336 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-fa898998-10c9-4985-a92f-f5392020eb1e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1724 microversion: 2.1 time: 0.224830 Oct 24 13:29:59.835925 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 311/621] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:29:59 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:30:00.749508 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a0861de5-5568-41aa-b030-5434a7d71b78 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:00.750159 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a0861de5-5568-41aa-b030-5434a7d71b78 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:00.758058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a0861de5-5568-41aa-b030-5434a7d71b78 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:00.758849 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a0861de5-5568-41aa-b030-5434a7d71b78 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:00.759271 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a0861de5-5568-41aa-b030-5434a7d71b78 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:00.761320 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a0861de5-5568-41aa-b030-5434a7d71b78 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:00.761775 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a0861de5-5568-41aa-b030-5434a7d71b78 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:00.769263 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a0861de5-5568-41aa-b030-5434a7d71b78 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:00.861815 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-4b3cf9a8-5d88-43a2-8f83-cfd547e24f5b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:00.862919 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-4b3cf9a8-5d88-43a2-8f83-cfd547e24f5b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:00.871728 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4b3cf9a8-5d88-43a2-8f83-cfd547e24f5b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:00.872467 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4b3cf9a8-5d88-43a2-8f83-cfd547e24f5b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:00.873376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4b3cf9a8-5d88-43a2-8f83-cfd547e24f5b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:00.874575 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4b3cf9a8-5d88-43a2-8f83-cfd547e24f5b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:00.875415 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4b3cf9a8-5d88-43a2-8f83-cfd547e24f5b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:00.876239 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4b3cf9a8-5d88-43a2-8f83-cfd547e24f5b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:00.902535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=100 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:00.973821 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a0861de5-5568-41aa-b030-5434a7d71b78 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:00.984792 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a0861de5-5568-41aa-b030-5434a7d71b78 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:00.988192 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a0861de5-5568-41aa-b030-5434a7d71b78 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:00.995402 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a0861de5-5568-41aa-b030-5434a7d71b78 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1737 microversion: 2.20 time: 0.249651 Oct 24 13:30:00.997353 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 311/622] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:00 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1737 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:01.116829 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-4b3cf9a8-5d88-43a2-8f83-cfd547e24f5b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:01.144461 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-4b3cf9a8-5d88-43a2-8f83-cfd547e24f5b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1701 microversion: 2.1 time: 0.274713 Oct 24 13:30:01.145740 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 312/623] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:30:00 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1701 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:30:01.159287 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a6d1b157-4ba6-44a8-9295-a3ca0db8963e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:30:01.168518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a6d1b157-4ba6-44a8-9295-a3ca0db8963e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:01.169338 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a6d1b157-4ba6-44a8-9295-a3ca0db8963e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:01.170041 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a6d1b157-4ba6-44a8-9295-a3ca0db8963e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:01.199429 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a6d1b157-4ba6-44a8-9295-a3ca0db8963e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Going to try to start instance {{(pid=119145) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 13:30:01.350288 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a6d1b157-4ba6-44a8-9295-a3ca0db8963e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "POST /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa/action" status: 202 len: 0 microversion: 2.1 time: 0.195943 Oct 24 13:30:01.354058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 312/624] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 24 13:30:01 2022] POST /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:30:01.361025 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f0c5430e-f0b6-4101-90a6-eda6bfc794a2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:01.361862 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f0c5430e-f0b6-4101-90a6-eda6bfc794a2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:01.382439 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f0c5430e-f0b6-4101-90a6-eda6bfc794a2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:01.388233 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f0c5430e-f0b6-4101-90a6-eda6bfc794a2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:01.388955 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f0c5430e-f0b6-4101-90a6-eda6bfc794a2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:01.389852 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f0c5430e-f0b6-4101-90a6-eda6bfc794a2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:01.390426 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f0c5430e-f0b6-4101-90a6-eda6bfc794a2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:01.390981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f0c5430e-f0b6-4101-90a6-eda6bfc794a2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:01.705783 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f0c5430e-f0b6-4101-90a6-eda6bfc794a2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:01.724454 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f0c5430e-f0b6-4101-90a6-eda6bfc794a2 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1710 microversion: 2.1 time: 0.368752 Oct 24 13:30:01.725632 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 313/625] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:30:01 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1710 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:30:02.034406 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-57eff88a-1e4f-45a4-9673-001233eb83c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:02.035713 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-57eff88a-1e4f-45a4-9673-001233eb83c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:02.047703 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-57eff88a-1e4f-45a4-9673-001233eb83c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:02.057256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-57eff88a-1e4f-45a4-9673-001233eb83c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:02.057944 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-57eff88a-1e4f-45a4-9673-001233eb83c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:02.059097 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-57eff88a-1e4f-45a4-9673-001233eb83c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:02.059708 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-57eff88a-1e4f-45a4-9673-001233eb83c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:02.060343 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-57eff88a-1e4f-45a4-9673-001233eb83c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:02.390507 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-57eff88a-1e4f-45a4-9673-001233eb83c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:02.406183 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-57eff88a-1e4f-45a4-9673-001233eb83c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:02.408195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-57eff88a-1e4f-45a4-9673-001233eb83c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:02.409478 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-57eff88a-1e4f-45a4-9673-001233eb83c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1737 microversion: 2.20 time: 0.380033 Oct 24 13:30:02.420007 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 313/626] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:02 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1737 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:02.751285 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9fd14fa8-c76b-411a-ba8e-e2dc3300cfc0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:02.751893 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-9fd14fa8-c76b-411a-ba8e-e2dc3300cfc0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:02.767422 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9fd14fa8-c76b-411a-ba8e-e2dc3300cfc0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:02.767914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9fd14fa8-c76b-411a-ba8e-e2dc3300cfc0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:02.768388 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9fd14fa8-c76b-411a-ba8e-e2dc3300cfc0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:02.769237 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9fd14fa8-c76b-411a-ba8e-e2dc3300cfc0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:02.769691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9fd14fa8-c76b-411a-ba8e-e2dc3300cfc0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:02.770115 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9fd14fa8-c76b-411a-ba8e-e2dc3300cfc0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:02.940491 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-9fd14fa8-c76b-411a-ba8e-e2dc3300cfc0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:02.952495 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9fd14fa8-c76b-411a-ba8e-e2dc3300cfc0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1710 microversion: 2.1 time: 0.206672 Oct 24 13:30:02.953238 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 314/627] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:30:02 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1710 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:30:03.461599 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a891d721-d813-4e5f-95a8-aa7bc65055e0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:03.462949 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a891d721-d813-4e5f-95a8-aa7bc65055e0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:03.474169 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a891d721-d813-4e5f-95a8-aa7bc65055e0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:03.474638 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a891d721-d813-4e5f-95a8-aa7bc65055e0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:03.475018 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a891d721-d813-4e5f-95a8-aa7bc65055e0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:03.475940 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a891d721-d813-4e5f-95a8-aa7bc65055e0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:03.476123 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a891d721-d813-4e5f-95a8-aa7bc65055e0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:03.476623 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a891d721-d813-4e5f-95a8-aa7bc65055e0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:03.681472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a891d721-d813-4e5f-95a8-aa7bc65055e0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:03.692089 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a891d721-d813-4e5f-95a8-aa7bc65055e0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:03.694361 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a891d721-d813-4e5f-95a8-aa7bc65055e0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:03.694532 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a891d721-d813-4e5f-95a8-aa7bc65055e0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1737 microversion: 2.20 time: 0.236904 Oct 24 13:30:03.695403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 314/628] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:03 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1737 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:03.984751 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e0d71da2-d262-4006-9d39-da8c47eec762 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:03.986173 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e0d71da2-d262-4006-9d39-da8c47eec762 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:03.998995 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e0d71da2-d262-4006-9d39-da8c47eec762 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:04.002654 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e0d71da2-d262-4006-9d39-da8c47eec762 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:04.002654 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e0d71da2-d262-4006-9d39-da8c47eec762 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:04.002654 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e0d71da2-d262-4006-9d39-da8c47eec762 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:04.004813 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e0d71da2-d262-4006-9d39-da8c47eec762 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:04.005487 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e0d71da2-d262-4006-9d39-da8c47eec762 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:04.216455 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e0d71da2-d262-4006-9d39-da8c47eec762 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:04.228222 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e0d71da2-d262-4006-9d39-da8c47eec762 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1710 microversion: 2.1 time: 0.252267 Oct 24 13:30:04.246217 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 315/629] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:30:03 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1710 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:30:04.727717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e8d94673-a837-45dc-89d9-8324e21abfe9 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c12c907-e63e-4616-9af9-ef376994f6ac", "device": "/dev/sdb"}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:30:04.728165 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-36a1913c-56de-4b87-b4e2-7692474907e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:04.730341 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-36a1913c-56de-4b87-b4e2-7692474907e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:04.731830 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e8d94673-a837-45dc-89d9-8324e21abfe9 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:04.738028 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-36a1913c-56de-4b87-b4e2-7692474907e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:04.738512 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-36a1913c-56de-4b87-b4e2-7692474907e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:04.738931 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-36a1913c-56de-4b87-b4e2-7692474907e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:04.739812 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-36a1913c-56de-4b87-b4e2-7692474907e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:04.740459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-36a1913c-56de-4b87-b4e2-7692474907e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:04.741014 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e8d94673-a837-45dc-89d9-8324e21abfe9 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:04.741188 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-36a1913c-56de-4b87-b4e2-7692474907e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:04.741909 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e8d94673-a837-45dc-89d9-8324e21abfe9 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:04.742580 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e8d94673-a837-45dc-89d9-8324e21abfe9 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:04.743755 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e8d94673-a837-45dc-89d9-8324e21abfe9 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:04.744583 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e8d94673-a837-45dc-89d9-8324e21abfe9 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:04.745296 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e8d94673-a837-45dc-89d9-8324e21abfe9 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:04.918924 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-36a1913c-56de-4b87-b4e2-7692474907e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:04.929546 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-36a1913c-56de-4b87-b4e2-7692474907e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:04.931072 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-36a1913c-56de-4b87-b4e2-7692474907e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:04.932548 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-36a1913c-56de-4b87-b4e2-7692474907e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1737 microversion: 2.20 time: 0.209474 Oct 24 13:30:04.933513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 315/630] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:04 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:05.254652 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7f8eb05e-77c1-45e6-bc35-9ded20590aaf tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:05.255554 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-7f8eb05e-77c1-45e6-bc35-9ded20590aaf tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:05.264352 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7f8eb05e-77c1-45e6-bc35-9ded20590aaf tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:05.281371 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7f8eb05e-77c1-45e6-bc35-9ded20590aaf tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:05.281880 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7f8eb05e-77c1-45e6-bc35-9ded20590aaf tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:05.282627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7f8eb05e-77c1-45e6-bc35-9ded20590aaf tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:05.283092 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7f8eb05e-77c1-45e6-bc35-9ded20590aaf tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:05.283509 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7f8eb05e-77c1-45e6-bc35-9ded20590aaf tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:05.498178 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-7f8eb05e-77c1-45e6-bc35-9ded20590aaf tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:05.509864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-7f8eb05e-77c1-45e6-bc35-9ded20590aaf tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1714 microversion: 2.1 time: 0.260014 Oct 24 13:30:05.511009 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 316/631] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:30:05 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1714 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:30:05.716828 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e8d94673-a837-45dc-89d9-8324e21abfe9 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "POST /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.993342 Oct 24 13:30:05.723089 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 316/632] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 24 13:30:04 2022] POST /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93/os-volume_attachments => generated 194 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:30:05.959126 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-fb59608d-d55d-4bf5-8d18-87f2694b789c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:05.959743 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-fb59608d-d55d-4bf5-8d18-87f2694b789c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:05.970192 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb59608d-d55d-4bf5-8d18-87f2694b789c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:05.970690 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb59608d-d55d-4bf5-8d18-87f2694b789c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:05.972672 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb59608d-d55d-4bf5-8d18-87f2694b789c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:05.973569 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb59608d-d55d-4bf5-8d18-87f2694b789c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:05.982923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb59608d-d55d-4bf5-8d18-87f2694b789c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:05.984153 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb59608d-d55d-4bf5-8d18-87f2694b789c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:06.200438 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-fb59608d-d55d-4bf5-8d18-87f2694b789c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:06.212872 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-fb59608d-d55d-4bf5-8d18-87f2694b789c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:06.214805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-fb59608d-d55d-4bf5-8d18-87f2694b789c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:06.216749 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-fb59608d-d55d-4bf5-8d18-87f2694b789c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1737 microversion: 2.20 time: 0.261551 Oct 24 13:30:06.223165 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 317/633] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:05 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1737 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:07.249739 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5e464fbf-9a25-45eb-b0da-381bdeeb2d23 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:07.252002 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5e464fbf-9a25-45eb-b0da-381bdeeb2d23 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:07.264805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e464fbf-9a25-45eb-b0da-381bdeeb2d23 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:07.265612 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e464fbf-9a25-45eb-b0da-381bdeeb2d23 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:07.269074 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e464fbf-9a25-45eb-b0da-381bdeeb2d23 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:07.269986 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e464fbf-9a25-45eb-b0da-381bdeeb2d23 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:07.270467 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e464fbf-9a25-45eb-b0da-381bdeeb2d23 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:07.270943 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e464fbf-9a25-45eb-b0da-381bdeeb2d23 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:07.448448 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5e464fbf-9a25-45eb-b0da-381bdeeb2d23 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:07.458995 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5e464fbf-9a25-45eb-b0da-381bdeeb2d23 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:07.460482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5e464fbf-9a25-45eb-b0da-381bdeeb2d23 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:07.462682 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5e464fbf-9a25-45eb-b0da-381bdeeb2d23 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1737 microversion: 2.20 time: 0.222125 Oct 24 13:30:07.468344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 317/634] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:07 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1737 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:08.490557 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-2133c45f-d03b-4b3d-a926-7a3e83639b2e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:08.491199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-2133c45f-d03b-4b3d-a926-7a3e83639b2e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:08.498337 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2133c45f-d03b-4b3d-a926-7a3e83639b2e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:08.498823 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2133c45f-d03b-4b3d-a926-7a3e83639b2e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:08.499764 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2133c45f-d03b-4b3d-a926-7a3e83639b2e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:08.500507 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2133c45f-d03b-4b3d-a926-7a3e83639b2e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:08.500972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2133c45f-d03b-4b3d-a926-7a3e83639b2e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:08.501391 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2133c45f-d03b-4b3d-a926-7a3e83639b2e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:08.638078 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-2133c45f-d03b-4b3d-a926-7a3e83639b2e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:08.646130 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-2133c45f-d03b-4b3d-a926-7a3e83639b2e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:08.647565 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-2133c45f-d03b-4b3d-a926-7a3e83639b2e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:08.648746 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-2133c45f-d03b-4b3d-a926-7a3e83639b2e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1737 microversion: 2.20 time: 0.162287 Oct 24 13:30:08.649304 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 318/635] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:08 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:09.675154 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7484438f-3ed9-4609-b356-941cca8c24da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:09.675890 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7484438f-3ed9-4609-b356-941cca8c24da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:09.688458 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7484438f-3ed9-4609-b356-941cca8c24da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:09.689079 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7484438f-3ed9-4609-b356-941cca8c24da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:09.689519 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7484438f-3ed9-4609-b356-941cca8c24da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:09.690217 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7484438f-3ed9-4609-b356-941cca8c24da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:09.690839 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7484438f-3ed9-4609-b356-941cca8c24da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:09.691251 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7484438f-3ed9-4609-b356-941cca8c24da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:09.837372 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7484438f-3ed9-4609-b356-941cca8c24da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:09.847643 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7484438f-3ed9-4609-b356-941cca8c24da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:09.849786 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7484438f-3ed9-4609-b356-941cca8c24da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:09.851060 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7484438f-3ed9-4609-b356-941cca8c24da tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1737 microversion: 2.20 time: 0.180424 Oct 24 13:30:09.851716 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 318/636] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:09 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:10.879427 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-885eaa6f-9bea-4c1c-bdcb-01786d0f5deb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:10.880001 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-885eaa6f-9bea-4c1c-bdcb-01786d0f5deb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:10.889630 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-885eaa6f-9bea-4c1c-bdcb-01786d0f5deb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:10.890160 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-885eaa6f-9bea-4c1c-bdcb-01786d0f5deb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:10.890897 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-885eaa6f-9bea-4c1c-bdcb-01786d0f5deb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:10.892080 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-885eaa6f-9bea-4c1c-bdcb-01786d0f5deb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:10.892971 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-885eaa6f-9bea-4c1c-bdcb-01786d0f5deb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:10.893538 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-885eaa6f-9bea-4c1c-bdcb-01786d0f5deb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:11.048351 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-885eaa6f-9bea-4c1c-bdcb-01786d0f5deb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:11.058744 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-885eaa6f-9bea-4c1c-bdcb-01786d0f5deb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:11.060765 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-885eaa6f-9bea-4c1c-bdcb-01786d0f5deb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:11.067869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-885eaa6f-9bea-4c1c-bdcb-01786d0f5deb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1737 microversion: 2.20 time: 0.192216 Oct 24 13:30:11.069340 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 319/637] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:10 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:12.095441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7ae73d98-be0f-4264-b0a2-7027aec35556 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:12.096070 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7ae73d98-be0f-4264-b0a2-7027aec35556 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:12.102587 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ae73d98-be0f-4264-b0a2-7027aec35556 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:12.103061 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ae73d98-be0f-4264-b0a2-7027aec35556 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:12.103486 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ae73d98-be0f-4264-b0a2-7027aec35556 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:12.104159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ae73d98-be0f-4264-b0a2-7027aec35556 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:12.104747 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ae73d98-be0f-4264-b0a2-7027aec35556 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:12.105165 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ae73d98-be0f-4264-b0a2-7027aec35556 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:12.241442 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7ae73d98-be0f-4264-b0a2-7027aec35556 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:12.254731 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7ae73d98-be0f-4264-b0a2-7027aec35556 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:12.254731 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7ae73d98-be0f-4264-b0a2-7027aec35556 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:12.255519 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7ae73d98-be0f-4264-b0a2-7027aec35556 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1737 microversion: 2.20 time: 0.163995 Oct 24 13:30:12.256296 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 319/638] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:12 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:13.282456 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-29750822-741c-4367-8ed9-1fba441536ea tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:13.283225 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-29750822-741c-4367-8ed9-1fba441536ea tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:13.293025 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-29750822-741c-4367-8ed9-1fba441536ea tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:13.293511 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-29750822-741c-4367-8ed9-1fba441536ea tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:13.293946 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-29750822-741c-4367-8ed9-1fba441536ea tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:13.296781 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-29750822-741c-4367-8ed9-1fba441536ea tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:13.297242 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-29750822-741c-4367-8ed9-1fba441536ea tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:13.297671 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-29750822-741c-4367-8ed9-1fba441536ea tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:13.568722 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-29750822-741c-4367-8ed9-1fba441536ea tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:13.577103 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-29750822-741c-4367-8ed9-1fba441536ea tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:13.578584 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-29750822-741c-4367-8ed9-1fba441536ea tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:13.579713 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-29750822-741c-4367-8ed9-1fba441536ea tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1737 microversion: 2.20 time: 0.301672 Oct 24 13:30:13.580560 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 320/639] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:13 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1737 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:14.609583 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1c964f88-51af-47e0-aab7-d50efed575b1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:14.610204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-1c964f88-51af-47e0-aab7-d50efed575b1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:14.617011 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c964f88-51af-47e0-aab7-d50efed575b1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:14.617710 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c964f88-51af-47e0-aab7-d50efed575b1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:14.619807 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c964f88-51af-47e0-aab7-d50efed575b1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:14.619807 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c964f88-51af-47e0-aab7-d50efed575b1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:14.619807 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c964f88-51af-47e0-aab7-d50efed575b1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:14.619807 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c964f88-51af-47e0-aab7-d50efed575b1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:14.763229 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1c964f88-51af-47e0-aab7-d50efed575b1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:14.772210 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1c964f88-51af-47e0-aab7-d50efed575b1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:14.773643 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1c964f88-51af-47e0-aab7-d50efed575b1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:14.774875 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1c964f88-51af-47e0-aab7-d50efed575b1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1737 microversion: 2.20 time: 0.173718 Oct 24 13:30:14.775479 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 320/640] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:14 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:15.800157 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-89c08430-acff-4c8b-81b3-4b7fba9a5363 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:15.800859 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-89c08430-acff-4c8b-81b3-4b7fba9a5363 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:15.803753 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=48 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:15.809247 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-89c08430-acff-4c8b-81b3-4b7fba9a5363 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:15.809952 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-89c08430-acff-4c8b-81b3-4b7fba9a5363 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:15.810578 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-89c08430-acff-4c8b-81b3-4b7fba9a5363 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:15.811752 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-89c08430-acff-4c8b-81b3-4b7fba9a5363 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:15.812350 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-89c08430-acff-4c8b-81b3-4b7fba9a5363 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:15.812930 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-89c08430-acff-4c8b-81b3-4b7fba9a5363 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:15.956610 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-89c08430-acff-4c8b-81b3-4b7fba9a5363 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:15.965359 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-89c08430-acff-4c8b-81b3-4b7fba9a5363 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:15.966779 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-89c08430-acff-4c8b-81b3-4b7fba9a5363 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:15.967970 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-89c08430-acff-4c8b-81b3-4b7fba9a5363 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1719 microversion: 2.20 time: 0.171682 Oct 24 13:30:15.969125 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 321/641] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:15 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:16.994704 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-35c47bd8-3587-4398-9160-732e8af8b73d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:16.995312 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-35c47bd8-3587-4398-9160-732e8af8b73d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:17.002302 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-35c47bd8-3587-4398-9160-732e8af8b73d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:17.002779 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-35c47bd8-3587-4398-9160-732e8af8b73d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:17.003216 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-35c47bd8-3587-4398-9160-732e8af8b73d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:17.003898 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-35c47bd8-3587-4398-9160-732e8af8b73d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:17.004367 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-35c47bd8-3587-4398-9160-732e8af8b73d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:17.004787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-35c47bd8-3587-4398-9160-732e8af8b73d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:17.282891 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-35c47bd8-3587-4398-9160-732e8af8b73d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:17.291141 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-35c47bd8-3587-4398-9160-732e8af8b73d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:17.292605 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-35c47bd8-3587-4398-9160-732e8af8b73d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:17.293757 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-35c47bd8-3587-4398-9160-732e8af8b73d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1719 microversion: 2.20 time: 0.303014 Oct 24 13:30:17.294307 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 321/642] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:16 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1719 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:18.319451 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-650bc534-36e7-48da-bcf3-db5008fae0e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:18.320057 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-650bc534-36e7-48da-bcf3-db5008fae0e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:18.326722 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-650bc534-36e7-48da-bcf3-db5008fae0e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:18.327196 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-650bc534-36e7-48da-bcf3-db5008fae0e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:18.328204 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-650bc534-36e7-48da-bcf3-db5008fae0e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:18.328905 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-650bc534-36e7-48da-bcf3-db5008fae0e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:18.329354 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-650bc534-36e7-48da-bcf3-db5008fae0e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:18.329771 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-650bc534-36e7-48da-bcf3-db5008fae0e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:18.507487 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-650bc534-36e7-48da-bcf3-db5008fae0e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:18.516244 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-650bc534-36e7-48da-bcf3-db5008fae0e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:18.517696 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-650bc534-36e7-48da-bcf3-db5008fae0e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:18.518844 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-650bc534-36e7-48da-bcf3-db5008fae0e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1719 microversion: 2.20 time: 0.203435 Oct 24 13:30:18.519400 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 322/643] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:18 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1719 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:19.543989 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b967b4fe-e679-4cb4-9821-a9c20dfbd803 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:19.544650 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b967b4fe-e679-4cb4-9821-a9c20dfbd803 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:19.551017 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b967b4fe-e679-4cb4-9821-a9c20dfbd803 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:19.551483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b967b4fe-e679-4cb4-9821-a9c20dfbd803 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:19.551908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b967b4fe-e679-4cb4-9821-a9c20dfbd803 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:19.552640 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b967b4fe-e679-4cb4-9821-a9c20dfbd803 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:19.553083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b967b4fe-e679-4cb4-9821-a9c20dfbd803 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:19.553495 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b967b4fe-e679-4cb4-9821-a9c20dfbd803 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:19.681933 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b967b4fe-e679-4cb4-9821-a9c20dfbd803 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:19.689822 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b967b4fe-e679-4cb4-9821-a9c20dfbd803 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:19.691234 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b967b4fe-e679-4cb4-9821-a9c20dfbd803 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:19.693218 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b967b4fe-e679-4cb4-9821-a9c20dfbd803 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1719 microversion: 2.20 time: 0.152273 Oct 24 13:30:19.696543 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 322/644] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:19 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:20.187678 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-392db3df-a1dd-4855-871f-7abce741182c req-dbd22f5f-2171-4b47-9e0e-fe1591713d62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d04bbb-034d-4cf1-a753-9c4cb48e92bd", "name": "network-vif-unplugged", "status": "completed", "tag": "4dfc7079-30d9-488d-9dfc-1df75d250b32"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:30:20.198269 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-392db3df-a1dd-4855-871f-7abce741182c req-dbd22f5f-2171-4b47-9e0e-fe1591713d62 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:20.198786 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-392db3df-a1dd-4855-871f-7abce741182c req-dbd22f5f-2171-4b47-9e0e-fe1591713d62 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:20.199207 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-392db3df-a1dd-4855-871f-7abce741182c req-dbd22f5f-2171-4b47-9e0e-fe1591713d62 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:20.211442 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-392db3df-a1dd-4855-871f-7abce741182c req-dbd22f5f-2171-4b47-9e0e-fe1591713d62 service nova] Creating event network-vif-unplugged:4dfc7079-30d9-488d-9dfc-1df75d250b32 for instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd on hv-cinder-86249 Oct 24 13:30:20.216579 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-392db3df-a1dd-4855-871f-7abce741182c req-dbd22f5f-2171-4b47-9e0e-fe1591713d62 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034009 Oct 24 13:30:20.217160 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 323/645] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:30:20.718956 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-605e3adb-dc8d-4c5f-949e-d0e5d7763f25 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:20.719555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-605e3adb-dc8d-4c5f-949e-d0e5d7763f25 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:20.726104 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-605e3adb-dc8d-4c5f-949e-d0e5d7763f25 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:20.726572 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-605e3adb-dc8d-4c5f-949e-d0e5d7763f25 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:20.726995 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-605e3adb-dc8d-4c5f-949e-d0e5d7763f25 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:20.727667 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-605e3adb-dc8d-4c5f-949e-d0e5d7763f25 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:20.728107 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-605e3adb-dc8d-4c5f-949e-d0e5d7763f25 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:20.728542 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-605e3adb-dc8d-4c5f-949e-d0e5d7763f25 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:20.865500 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-605e3adb-dc8d-4c5f-949e-d0e5d7763f25 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:20.873819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-605e3adb-dc8d-4c5f-949e-d0e5d7763f25 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:20.875295 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-605e3adb-dc8d-4c5f-949e-d0e5d7763f25 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:20.876484 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-605e3adb-dc8d-4c5f-949e-d0e5d7763f25 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1719 microversion: 2.20 time: 0.162163 Oct 24 13:30:20.877066 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 323/646] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:20 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:21.903318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-3d60058a-ca1f-40f3-96e5-1d29c68a78e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:21.904007 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-3d60058a-ca1f-40f3-96e5-1d29c68a78e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:21.910450 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3d60058a-ca1f-40f3-96e5-1d29c68a78e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:21.910931 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3d60058a-ca1f-40f3-96e5-1d29c68a78e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:21.911364 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3d60058a-ca1f-40f3-96e5-1d29c68a78e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:21.912050 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3d60058a-ca1f-40f3-96e5-1d29c68a78e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:21.912541 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3d60058a-ca1f-40f3-96e5-1d29c68a78e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:21.912963 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3d60058a-ca1f-40f3-96e5-1d29c68a78e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:22.045387 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-3d60058a-ca1f-40f3-96e5-1d29c68a78e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:22.054293 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-3d60058a-ca1f-40f3-96e5-1d29c68a78e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:22.055724 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-3d60058a-ca1f-40f3-96e5-1d29c68a78e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:22.056926 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-3d60058a-ca1f-40f3-96e5-1d29c68a78e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1662 microversion: 2.20 time: 0.158339 Oct 24 13:30:22.057485 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 324/647] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:21 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1662 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:22.082383 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5b151c2e-2b7f-4b03-aeaf-7217e5ad8f47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2469b8b-3f89-45c5-98a7-5096f3448753"}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:30:22.084856 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5b151c2e-2b7f-4b03-aeaf-7217e5ad8f47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:22.091528 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5b151c2e-2b7f-4b03-aeaf-7217e5ad8f47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:22.091937 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5b151c2e-2b7f-4b03-aeaf-7217e5ad8f47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:22.092393 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5b151c2e-2b7f-4b03-aeaf-7217e5ad8f47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:22.093078 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5b151c2e-2b7f-4b03-aeaf-7217e5ad8f47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:22.093522 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5b151c2e-2b7f-4b03-aeaf-7217e5ad8f47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:22.094446 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5b151c2e-2b7f-4b03-aeaf-7217e5ad8f47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:22.938035 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5b151c2e-2b7f-4b03-aeaf-7217e5ad8f47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "POST /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.859598 Oct 24 13:30:22.938636 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 324/648] 10.222.0.48 () {62 vars in 1364 bytes} [Mon Oct 24 13:30:22 2022] POST /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd/os-volume_attachments => generated 188 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 13:30:23.074369 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e7b46a8d-8e7d-49ea-9cc2-62382ffe5f4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:30:23.074955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e7b46a8d-8e7d-49ea-9cc2-62382ffe5f4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:23.084539 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e7b46a8d-8e7d-49ea-9cc2-62382ffe5f4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:23.085072 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e7b46a8d-8e7d-49ea-9cc2-62382ffe5f4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:23.085445 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e7b46a8d-8e7d-49ea-9cc2-62382ffe5f4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:23.086142 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e7b46a8d-8e7d-49ea-9cc2-62382ffe5f4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:23.086603 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e7b46a8d-8e7d-49ea-9cc2-62382ffe5f4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:23.087017 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e7b46a8d-8e7d-49ea-9cc2-62382ffe5f4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:23.131476 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e7b46a8d-8e7d-49ea-9cc2-62382ffe5f4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119145) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 24 13:30:23.397745 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e7b46a8d-8e7d-49ea-9cc2-62382ffe5f4d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "POST /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd/action" status: 202 len: 0 microversion: 2.20 time: 0.327332 Oct 24 13:30:23.398355 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 325/649] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 24 13:30:23 2022] POST /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:30:23.407160 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-16160d8f-3af6-435b-b15d-5cc415f7edd6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:23.407767 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-16160d8f-3af6-435b-b15d-5cc415f7edd6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:23.414866 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-16160d8f-3af6-435b-b15d-5cc415f7edd6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:23.418220 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-16160d8f-3af6-435b-b15d-5cc415f7edd6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:23.418220 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-16160d8f-3af6-435b-b15d-5cc415f7edd6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:23.418220 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-16160d8f-3af6-435b-b15d-5cc415f7edd6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:23.418220 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-16160d8f-3af6-435b-b15d-5cc415f7edd6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:23.418584 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-16160d8f-3af6-435b-b15d-5cc415f7edd6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:23.421711 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:23.550756 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-16160d8f-3af6-435b-b15d-5cc415f7edd6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:23.559990 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-16160d8f-3af6-435b-b15d-5cc415f7edd6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:23.561567 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-16160d8f-3af6-435b-b15d-5cc415f7edd6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:23.562925 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-16160d8f-3af6-435b-b15d-5cc415f7edd6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1748 microversion: 2.20 time: 0.160015 Oct 24 13:30:23.564612 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 325/650] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:23 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:24.588938 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-81197e7d-1c3d-49c4-8513-6abfa7f33e5d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:24.589467 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-81197e7d-1c3d-49c4-8513-6abfa7f33e5d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:24.596212 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81197e7d-1c3d-49c4-8513-6abfa7f33e5d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:24.596714 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81197e7d-1c3d-49c4-8513-6abfa7f33e5d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:24.597165 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81197e7d-1c3d-49c4-8513-6abfa7f33e5d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:24.597866 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81197e7d-1c3d-49c4-8513-6abfa7f33e5d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:24.598381 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81197e7d-1c3d-49c4-8513-6abfa7f33e5d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:24.598803 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81197e7d-1c3d-49c4-8513-6abfa7f33e5d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:24.603624 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:24.732567 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-81197e7d-1c3d-49c4-8513-6abfa7f33e5d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:24.741167 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-81197e7d-1c3d-49c4-8513-6abfa7f33e5d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:24.742774 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-81197e7d-1c3d-49c4-8513-6abfa7f33e5d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:24.743930 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-81197e7d-1c3d-49c4-8513-6abfa7f33e5d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1748 microversion: 2.20 time: 0.159736 Oct 24 13:30:24.744524 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 326/651] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:24 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:25.770140 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8798f604-5919-4eec-91e2-99b2cf36c491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:25.770747 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8798f604-5919-4eec-91e2-99b2cf36c491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:25.774237 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=42 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:25.777539 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8798f604-5919-4eec-91e2-99b2cf36c491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:25.778014 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8798f604-5919-4eec-91e2-99b2cf36c491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:25.778447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8798f604-5919-4eec-91e2-99b2cf36c491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:25.779133 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8798f604-5919-4eec-91e2-99b2cf36c491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:25.779581 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8798f604-5919-4eec-91e2-99b2cf36c491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:25.779998 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8798f604-5919-4eec-91e2-99b2cf36c491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:25.915090 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8798f604-5919-4eec-91e2-99b2cf36c491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:25.924159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8798f604-5919-4eec-91e2-99b2cf36c491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:25.925795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8798f604-5919-4eec-91e2-99b2cf36c491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:25.926944 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8798f604-5919-4eec-91e2-99b2cf36c491 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1748 microversion: 2.20 time: 0.161669 Oct 24 13:30:25.927505 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 326/652] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:25 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:26.952202 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-2fafcb76-0e6d-4b0e-92fb-23f4b29f93ca tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:26.952830 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-2fafcb76-0e6d-4b0e-92fb-23f4b29f93ca tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:26.960297 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2fafcb76-0e6d-4b0e-92fb-23f4b29f93ca tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:26.960782 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2fafcb76-0e6d-4b0e-92fb-23f4b29f93ca tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:26.961203 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2fafcb76-0e6d-4b0e-92fb-23f4b29f93ca tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:26.961890 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2fafcb76-0e6d-4b0e-92fb-23f4b29f93ca tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:26.962332 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2fafcb76-0e6d-4b0e-92fb-23f4b29f93ca tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:26.962740 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2fafcb76-0e6d-4b0e-92fb-23f4b29f93ca tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:27.096870 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-2fafcb76-0e6d-4b0e-92fb-23f4b29f93ca tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:27.105449 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-2fafcb76-0e6d-4b0e-92fb-23f4b29f93ca tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:27.107379 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-2fafcb76-0e6d-4b0e-92fb-23f4b29f93ca tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:27.108618 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-2fafcb76-0e6d-4b0e-92fb-23f4b29f93ca tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1748 microversion: 2.20 time: 0.160549 Oct 24 13:30:27.109178 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 327/653] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:26 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:28.134924 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-97864478-bce6-42fa-abb3-46b467f25024 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:28.139324 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-97864478-bce6-42fa-abb3-46b467f25024 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:28.142084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-97864478-bce6-42fa-abb3-46b467f25024 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:28.143113 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-97864478-bce6-42fa-abb3-46b467f25024 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:28.143576 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-97864478-bce6-42fa-abb3-46b467f25024 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:28.144258 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-97864478-bce6-42fa-abb3-46b467f25024 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:28.144724 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-97864478-bce6-42fa-abb3-46b467f25024 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:28.145267 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-97864478-bce6-42fa-abb3-46b467f25024 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:28.272207 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-97864478-bce6-42fa-abb3-46b467f25024 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:28.280668 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-97864478-bce6-42fa-abb3-46b467f25024 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:28.282085 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-97864478-bce6-42fa-abb3-46b467f25024 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:28.283309 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-97864478-bce6-42fa-abb3-46b467f25024 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1748 microversion: 2.20 time: 0.152184 Oct 24 13:30:28.283864 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 327/654] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:28 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:29.422730 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-81b22239-3b77-475d-ab4b-04fb1d80cce5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:29.423331 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-81b22239-3b77-475d-ab4b-04fb1d80cce5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:29.429809 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81b22239-3b77-475d-ab4b-04fb1d80cce5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:29.430477 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81b22239-3b77-475d-ab4b-04fb1d80cce5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:29.431122 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81b22239-3b77-475d-ab4b-04fb1d80cce5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:29.432035 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81b22239-3b77-475d-ab4b-04fb1d80cce5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:29.432772 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81b22239-3b77-475d-ab4b-04fb1d80cce5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:29.433195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81b22239-3b77-475d-ab4b-04fb1d80cce5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:29.579338 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-81b22239-3b77-475d-ab4b-04fb1d80cce5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:29.593207 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-81b22239-3b77-475d-ab4b-04fb1d80cce5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:29.593207 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-81b22239-3b77-475d-ab4b-04fb1d80cce5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:29.593765 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-81b22239-3b77-475d-ab4b-04fb1d80cce5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1748 microversion: 2.20 time: 0.288127 Oct 24 13:30:29.595230 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 328/655] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:29 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1748 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:30.620354 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e3347a2c-6d75-4600-bc57-163f23fe19f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:30.620931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e3347a2c-6d75-4600-bc57-163f23fe19f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:30.623655 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 13:30:30.623789 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Mon Oct 24 13:30:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd (ip 10.222.0.48) !!! Oct 24 13:30:30.629488 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e3347a2c-6d75-4600-bc57-163f23fe19f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:30.629970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e3347a2c-6d75-4600-bc57-163f23fe19f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:30.630406 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e3347a2c-6d75-4600-bc57-163f23fe19f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:30.631099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e3347a2c-6d75-4600-bc57-163f23fe19f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:30.631554 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e3347a2c-6d75-4600-bc57-163f23fe19f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:30.631974 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e3347a2c-6d75-4600-bc57-163f23fe19f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:30.774833 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e3347a2c-6d75-4600-bc57-163f23fe19f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:30.782695 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e3347a2c-6d75-4600-bc57-163f23fe19f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:30.784739 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e3347a2c-6d75-4600-bc57-163f23fe19f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:30.785880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e3347a2c-6d75-4600-bc57-163f23fe19f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1750 microversion: 2.20 time: 0.169667 Oct 24 13:30:30.786430 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 328/656] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:30 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1750 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:31.813951 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a721e1e3-9ec5-499e-afa8-89561552aa34 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:31.815851 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a721e1e3-9ec5-499e-afa8-89561552aa34 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:31.826271 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a721e1e3-9ec5-499e-afa8-89561552aa34 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:31.826757 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a721e1e3-9ec5-499e-afa8-89561552aa34 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:31.827185 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a721e1e3-9ec5-499e-afa8-89561552aa34 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:31.828168 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a721e1e3-9ec5-499e-afa8-89561552aa34 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:31.828831 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a721e1e3-9ec5-499e-afa8-89561552aa34 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:31.829239 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a721e1e3-9ec5-499e-afa8-89561552aa34 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:32.045554 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a721e1e3-9ec5-499e-afa8-89561552aa34 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:32.055659 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a721e1e3-9ec5-499e-afa8-89561552aa34 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:32.057200 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a721e1e3-9ec5-499e-afa8-89561552aa34 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:32.058375 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a721e1e3-9ec5-499e-afa8-89561552aa34 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.250109 Oct 24 13:30:32.058931 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 329/657] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:31 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:33.086002 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-010fd1ff-b595-492f-b659-0dad33da9fa3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:33.086618 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-010fd1ff-b595-492f-b659-0dad33da9fa3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:33.093692 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-010fd1ff-b595-492f-b659-0dad33da9fa3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:33.094178 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-010fd1ff-b595-492f-b659-0dad33da9fa3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:33.094833 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-010fd1ff-b595-492f-b659-0dad33da9fa3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:33.095835 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-010fd1ff-b595-492f-b659-0dad33da9fa3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:33.095983 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-010fd1ff-b595-492f-b659-0dad33da9fa3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:33.097043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-010fd1ff-b595-492f-b659-0dad33da9fa3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:33.232505 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-010fd1ff-b595-492f-b659-0dad33da9fa3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:33.239957 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-010fd1ff-b595-492f-b659-0dad33da9fa3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:33.241422 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-010fd1ff-b595-492f-b659-0dad33da9fa3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:33.242736 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-010fd1ff-b595-492f-b659-0dad33da9fa3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.160663 Oct 24 13:30:33.243295 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 329/658] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:33 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:34.266532 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 13:30:34.267072 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Mon Oct 24 13:30:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd (ip 10.222.0.48) !!! Oct 24 13:30:34.272043 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-81cf9a16-c9de-4325-9d37-4e47795678ff tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:34.272743 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-81cf9a16-c9de-4325-9d37-4e47795678ff tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:34.280034 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81cf9a16-c9de-4325-9d37-4e47795678ff tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:34.280548 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81cf9a16-c9de-4325-9d37-4e47795678ff tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:34.280971 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81cf9a16-c9de-4325-9d37-4e47795678ff tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:34.281842 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81cf9a16-c9de-4325-9d37-4e47795678ff tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:34.282329 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81cf9a16-c9de-4325-9d37-4e47795678ff tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:34.282750 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81cf9a16-c9de-4325-9d37-4e47795678ff tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:34.424159 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-81cf9a16-c9de-4325-9d37-4e47795678ff tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:34.433324 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-81cf9a16-c9de-4325-9d37-4e47795678ff tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:34.434765 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-81cf9a16-c9de-4325-9d37-4e47795678ff tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:34.435956 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-81cf9a16-c9de-4325-9d37-4e47795678ff tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.171152 Oct 24 13:30:34.436547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 330/659] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:34 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:35.462238 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3ec53d4b-dd75-4171-87f2-570838c4aef1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:35.462844 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-3ec53d4b-dd75-4171-87f2-570838c4aef1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:35.465311 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 13:30:35.465450 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Mon Oct 24 13:30:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd (ip 10.222.0.48) !!! Oct 24 13:30:35.479119 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3ec53d4b-dd75-4171-87f2-570838c4aef1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:35.479530 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3ec53d4b-dd75-4171-87f2-570838c4aef1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:35.479966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3ec53d4b-dd75-4171-87f2-570838c4aef1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:35.480706 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3ec53d4b-dd75-4171-87f2-570838c4aef1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:35.481161 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3ec53d4b-dd75-4171-87f2-570838c4aef1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:35.481581 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3ec53d4b-dd75-4171-87f2-570838c4aef1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:35.619169 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3ec53d4b-dd75-4171-87f2-570838c4aef1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:35.628979 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3ec53d4b-dd75-4171-87f2-570838c4aef1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:35.630421 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3ec53d4b-dd75-4171-87f2-570838c4aef1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:35.631698 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3ec53d4b-dd75-4171-87f2-570838c4aef1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.173385 Oct 24 13:30:35.632460 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 330/660] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:35 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:36.657052 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ecad1a90-7790-40e3-a3ca-96ee3822628e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:36.657666 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ecad1a90-7790-40e3-a3ca-96ee3822628e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:36.665461 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ecad1a90-7790-40e3-a3ca-96ee3822628e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:36.665946 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ecad1a90-7790-40e3-a3ca-96ee3822628e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:36.666374 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ecad1a90-7790-40e3-a3ca-96ee3822628e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:36.667122 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ecad1a90-7790-40e3-a3ca-96ee3822628e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:36.667571 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ecad1a90-7790-40e3-a3ca-96ee3822628e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:36.668209 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ecad1a90-7790-40e3-a3ca-96ee3822628e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:36.884251 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ecad1a90-7790-40e3-a3ca-96ee3822628e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:36.893163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ecad1a90-7790-40e3-a3ca-96ee3822628e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:36.894769 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ecad1a90-7790-40e3-a3ca-96ee3822628e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:36.896243 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ecad1a90-7790-40e3-a3ca-96ee3822628e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.243252 Oct 24 13:30:36.912437 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 331/661] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:36 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:37.922390 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7fc8f9c6-d3a7-4b23-8d67-2228a76e8146 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:37.922997 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7fc8f9c6-d3a7-4b23-8d67-2228a76e8146 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:37.929489 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7fc8f9c6-d3a7-4b23-8d67-2228a76e8146 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:37.929962 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7fc8f9c6-d3a7-4b23-8d67-2228a76e8146 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:37.930388 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7fc8f9c6-d3a7-4b23-8d67-2228a76e8146 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:37.931065 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7fc8f9c6-d3a7-4b23-8d67-2228a76e8146 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:37.931510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7fc8f9c6-d3a7-4b23-8d67-2228a76e8146 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:37.931922 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7fc8f9c6-d3a7-4b23-8d67-2228a76e8146 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:38.064125 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7fc8f9c6-d3a7-4b23-8d67-2228a76e8146 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:38.073407 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7fc8f9c6-d3a7-4b23-8d67-2228a76e8146 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:38.074824 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7fc8f9c6-d3a7-4b23-8d67-2228a76e8146 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:38.076649 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7fc8f9c6-d3a7-4b23-8d67-2228a76e8146 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.158161 Oct 24 13:30:38.077210 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 331/662] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:37 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:39.103826 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-cddfb4da-0789-4745-965c-182cfefa7d24 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:39.105749 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-cddfb4da-0789-4745-965c-182cfefa7d24 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:39.116331 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cddfb4da-0789-4745-965c-182cfefa7d24 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:39.117584 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cddfb4da-0789-4745-965c-182cfefa7d24 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:39.118595 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cddfb4da-0789-4745-965c-182cfefa7d24 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:39.129723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cddfb4da-0789-4745-965c-182cfefa7d24 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:39.130583 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cddfb4da-0789-4745-965c-182cfefa7d24 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:39.131403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cddfb4da-0789-4745-965c-182cfefa7d24 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:39.267014 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-cddfb4da-0789-4745-965c-182cfefa7d24 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:39.277248 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-cddfb4da-0789-4745-965c-182cfefa7d24 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:39.278792 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-cddfb4da-0789-4745-965c-182cfefa7d24 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:39.279948 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-cddfb4da-0789-4745-965c-182cfefa7d24 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.180988 Oct 24 13:30:39.280543 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 332/663] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:39 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:40.305272 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-0d796c0d-0a45-42e4-af5d-49d959edc8d5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:40.305885 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-0d796c0d-0a45-42e4-af5d-49d959edc8d5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:40.312299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0d796c0d-0a45-42e4-af5d-49d959edc8d5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:40.312795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0d796c0d-0a45-42e4-af5d-49d959edc8d5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:40.317810 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0d796c0d-0a45-42e4-af5d-49d959edc8d5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:40.317810 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0d796c0d-0a45-42e4-af5d-49d959edc8d5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:40.317810 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0d796c0d-0a45-42e4-af5d-49d959edc8d5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:40.317810 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0d796c0d-0a45-42e4-af5d-49d959edc8d5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:40.445329 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-0d796c0d-0a45-42e4-af5d-49d959edc8d5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:40.455610 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-0d796c0d-0a45-42e4-af5d-49d959edc8d5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:40.457860 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-0d796c0d-0a45-42e4-af5d-49d959edc8d5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:40.459178 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-0d796c0d-0a45-42e4-af5d-49d959edc8d5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.157730 Oct 24 13:30:40.460086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 332/664] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:40 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:30:41.488621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a0fc9e55-d8a6-44fc-8e91-3c9db1faa3b2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:41.489476 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a0fc9e55-d8a6-44fc-8e91-3c9db1faa3b2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:41.496481 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a0fc9e55-d8a6-44fc-8e91-3c9db1faa3b2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:41.497672 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a0fc9e55-d8a6-44fc-8e91-3c9db1faa3b2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:41.497672 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a0fc9e55-d8a6-44fc-8e91-3c9db1faa3b2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:41.498055 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a0fc9e55-d8a6-44fc-8e91-3c9db1faa3b2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:41.498663 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a0fc9e55-d8a6-44fc-8e91-3c9db1faa3b2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:41.499084 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a0fc9e55-d8a6-44fc-8e91-3c9db1faa3b2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:41.642257 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a0fc9e55-d8a6-44fc-8e91-3c9db1faa3b2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:41.651834 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a0fc9e55-d8a6-44fc-8e91-3c9db1faa3b2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:41.653402 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a0fc9e55-d8a6-44fc-8e91-3c9db1faa3b2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:41.654889 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a0fc9e55-d8a6-44fc-8e91-3c9db1faa3b2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.171151 Oct 24 13:30:41.655485 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 333/665] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:41 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:42.055480 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b7df36f1-c0c9-40e1-a7e2-c3bfb07eb829 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:42.056701 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b7df36f1-c0c9-40e1-a7e2-c3bfb07eb829 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:42.063560 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b7df36f1-c0c9-40e1-a7e2-c3bfb07eb829 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:42.064133 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b7df36f1-c0c9-40e1-a7e2-c3bfb07eb829 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:42.064652 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b7df36f1-c0c9-40e1-a7e2-c3bfb07eb829 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:42.065408 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b7df36f1-c0c9-40e1-a7e2-c3bfb07eb829 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:42.066709 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b7df36f1-c0c9-40e1-a7e2-c3bfb07eb829 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:42.067194 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b7df36f1-c0c9-40e1-a7e2-c3bfb07eb829 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:42.196520 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.objects.instance [None req-b7df36f1-c0c9-40e1-a7e2-c3bfb07eb829 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lazy-loading 'services' on Instance uuid 045d0b97-923d-4969-a8f5-664dbc753b93 {{(pid=119146) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:30:42.412235 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b7df36f1-c0c9-40e1-a7e2-c3bfb07eb829 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "DELETE /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93/os-volume_attachments/4c12c907-e63e-4616-9af9-ef376994f6ac" status: 202 len: 0 microversion: 2.1 time: 0.360509 Oct 24 13:30:42.412980 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 333/666] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 24 13:30:42 2022] DELETE /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93/os-volume_attachments/4c12c907-e63e-4616-9af9-ef376994f6ac => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:30:42.680251 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6ba19694-a697-45d9-844b-4c6f222fd164 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:42.680883 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-6ba19694-a697-45d9-844b-4c6f222fd164 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:42.687205 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ba19694-a697-45d9-844b-4c6f222fd164 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:42.687686 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ba19694-a697-45d9-844b-4c6f222fd164 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:42.688108 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ba19694-a697-45d9-844b-4c6f222fd164 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:42.689104 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ba19694-a697-45d9-844b-4c6f222fd164 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:42.689552 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ba19694-a697-45d9-844b-4c6f222fd164 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:42.689967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ba19694-a697-45d9-844b-4c6f222fd164 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:42.818890 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-6ba19694-a697-45d9-844b-4c6f222fd164 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:42.827729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-6ba19694-a697-45d9-844b-4c6f222fd164 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:42.829193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-6ba19694-a697-45d9-844b-4c6f222fd164 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:42.830335 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6ba19694-a697-45d9-844b-4c6f222fd164 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.153994 Oct 24 13:30:42.830891 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 334/667] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:42 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:43.857123 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1e8e5fc7-d5b5-48d4-bb9c-4c7da443adae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:43.857777 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-1e8e5fc7-d5b5-48d4-bb9c-4c7da443adae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:43.863989 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1e8e5fc7-d5b5-48d4-bb9c-4c7da443adae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:43.864501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1e8e5fc7-d5b5-48d4-bb9c-4c7da443adae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:43.864930 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1e8e5fc7-d5b5-48d4-bb9c-4c7da443adae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:43.865608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1e8e5fc7-d5b5-48d4-bb9c-4c7da443adae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:43.866054 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1e8e5fc7-d5b5-48d4-bb9c-4c7da443adae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:43.866471 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1e8e5fc7-d5b5-48d4-bb9c-4c7da443adae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:43.997512 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1e8e5fc7-d5b5-48d4-bb9c-4c7da443adae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:44.006403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1e8e5fc7-d5b5-48d4-bb9c-4c7da443adae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:44.007838 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1e8e5fc7-d5b5-48d4-bb9c-4c7da443adae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:44.009025 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1e8e5fc7-d5b5-48d4-bb9c-4c7da443adae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.156750 Oct 24 13:30:44.009585 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 334/668] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:43 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:45.035071 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e3bb10a8-f772-4563-b462-c4175d3b8dad tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:45.035776 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e3bb10a8-f772-4563-b462-c4175d3b8dad tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:45.042179 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e3bb10a8-f772-4563-b462-c4175d3b8dad tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:45.042650 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e3bb10a8-f772-4563-b462-c4175d3b8dad tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:45.043075 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e3bb10a8-f772-4563-b462-c4175d3b8dad tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:45.043781 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e3bb10a8-f772-4563-b462-c4175d3b8dad tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:45.044225 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e3bb10a8-f772-4563-b462-c4175d3b8dad tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:45.045252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e3bb10a8-f772-4563-b462-c4175d3b8dad tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:45.197935 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e3bb10a8-f772-4563-b462-c4175d3b8dad tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:45.208852 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e3bb10a8-f772-4563-b462-c4175d3b8dad tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:45.210334 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e3bb10a8-f772-4563-b462-c4175d3b8dad tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:45.211596 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e3bb10a8-f772-4563-b462-c4175d3b8dad tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.180377 Oct 24 13:30:45.212233 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 335/669] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:45 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:30:46.249047 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5694bf9c-eab1-4131-98ea-d125ff1b6189 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:46.250099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5694bf9c-eab1-4131-98ea-d125ff1b6189 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:46.259502 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5694bf9c-eab1-4131-98ea-d125ff1b6189 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:46.260103 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5694bf9c-eab1-4131-98ea-d125ff1b6189 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:46.260562 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5694bf9c-eab1-4131-98ea-d125ff1b6189 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:46.261253 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5694bf9c-eab1-4131-98ea-d125ff1b6189 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:46.261694 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5694bf9c-eab1-4131-98ea-d125ff1b6189 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:46.262258 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5694bf9c-eab1-4131-98ea-d125ff1b6189 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:46.399723 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5694bf9c-eab1-4131-98ea-d125ff1b6189 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:46.408245 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5694bf9c-eab1-4131-98ea-d125ff1b6189 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:46.409690 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5694bf9c-eab1-4131-98ea-d125ff1b6189 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:46.410833 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5694bf9c-eab1-4131-98ea-d125ff1b6189 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.167281 Oct 24 13:30:46.411397 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 335/670] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:46 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:47.437229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-04f3d066-1417-4588-b856-c3999f177d86 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:47.437914 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-04f3d066-1417-4588-b856-c3999f177d86 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:47.440454 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:47.445411 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-04f3d066-1417-4588-b856-c3999f177d86 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:47.445881 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-04f3d066-1417-4588-b856-c3999f177d86 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:47.446324 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-04f3d066-1417-4588-b856-c3999f177d86 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:47.446978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-04f3d066-1417-4588-b856-c3999f177d86 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:47.447459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-04f3d066-1417-4588-b856-c3999f177d86 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:47.447933 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-04f3d066-1417-4588-b856-c3999f177d86 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:47.590907 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-04f3d066-1417-4588-b856-c3999f177d86 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:47.608462 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-04f3d066-1417-4588-b856-c3999f177d86 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:47.610135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-04f3d066-1417-4588-b856-c3999f177d86 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:47.611378 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-04f3d066-1417-4588-b856-c3999f177d86 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.178275 Oct 24 13:30:47.612089 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 336/671] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:47 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:48.638995 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f0d76135-2737-42e5-82af-94456339072a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:48.639618 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f0d76135-2737-42e5-82af-94456339072a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:48.646838 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f0d76135-2737-42e5-82af-94456339072a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:48.647315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f0d76135-2737-42e5-82af-94456339072a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:48.647746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f0d76135-2737-42e5-82af-94456339072a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:48.648463 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f0d76135-2737-42e5-82af-94456339072a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:48.648913 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f0d76135-2737-42e5-82af-94456339072a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:48.649329 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f0d76135-2737-42e5-82af-94456339072a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:48.786824 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f0d76135-2737-42e5-82af-94456339072a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:48.797507 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f0d76135-2737-42e5-82af-94456339072a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:48.799194 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f0d76135-2737-42e5-82af-94456339072a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:48.800836 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f0d76135-2737-42e5-82af-94456339072a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.165677 Oct 24 13:30:48.815264 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 336/672] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:48 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:49.827398 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-39ea3e8f-7124-462c-a5e0-e0976100846f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:49.828001 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-39ea3e8f-7124-462c-a5e0-e0976100846f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:49.835803 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-39ea3e8f-7124-462c-a5e0-e0976100846f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:49.836346 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-39ea3e8f-7124-462c-a5e0-e0976100846f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:49.836784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-39ea3e8f-7124-462c-a5e0-e0976100846f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:49.837460 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-39ea3e8f-7124-462c-a5e0-e0976100846f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:49.837942 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-39ea3e8f-7124-462c-a5e0-e0976100846f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:49.838360 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-39ea3e8f-7124-462c-a5e0-e0976100846f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:49.990946 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-39ea3e8f-7124-462c-a5e0-e0976100846f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:50.000323 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-39ea3e8f-7124-462c-a5e0-e0976100846f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:50.001861 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-39ea3e8f-7124-462c-a5e0-e0976100846f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:50.003019 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-39ea3e8f-7124-462c-a5e0-e0976100846f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.179913 Oct 24 13:30:50.004139 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 337/673] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:49 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:51.029251 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c61326a3-0b50-44d5-a1ec-3d472d81d2e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:51.029855 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c61326a3-0b50-44d5-a1ec-3d472d81d2e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:51.037668 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c61326a3-0b50-44d5-a1ec-3d472d81d2e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:51.052410 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c61326a3-0b50-44d5-a1ec-3d472d81d2e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:51.052410 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c61326a3-0b50-44d5-a1ec-3d472d81d2e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:51.052410 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c61326a3-0b50-44d5-a1ec-3d472d81d2e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:51.052410 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c61326a3-0b50-44d5-a1ec-3d472d81d2e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:51.052881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c61326a3-0b50-44d5-a1ec-3d472d81d2e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:51.173015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c61326a3-0b50-44d5-a1ec-3d472d81d2e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:51.181771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c61326a3-0b50-44d5-a1ec-3d472d81d2e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:51.183210 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c61326a3-0b50-44d5-a1ec-3d472d81d2e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:51.184390 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c61326a3-0b50-44d5-a1ec-3d472d81d2e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.159029 Oct 24 13:30:51.184945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 337/674] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:51 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:52.210772 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0a0959e6-2997-4450-b542-4b147a99de43 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:52.211515 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0a0959e6-2997-4450-b542-4b147a99de43 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:52.217780 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0a0959e6-2997-4450-b542-4b147a99de43 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:52.218253 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0a0959e6-2997-4450-b542-4b147a99de43 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:52.218692 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0a0959e6-2997-4450-b542-4b147a99de43 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:52.219350 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0a0959e6-2997-4450-b542-4b147a99de43 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:52.219799 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0a0959e6-2997-4450-b542-4b147a99de43 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:52.220219 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0a0959e6-2997-4450-b542-4b147a99de43 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:52.351534 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0a0959e6-2997-4450-b542-4b147a99de43 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:52.357780 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0a0959e6-2997-4450-b542-4b147a99de43 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:52.359195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0a0959e6-2997-4450-b542-4b147a99de43 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:52.360359 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0a0959e6-2997-4450-b542-4b147a99de43 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.153673 Oct 24 13:30:52.360913 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 338/675] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:52 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:53.386622 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-82138b69-ef94-4493-9839-2b616ad47ebc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:53.387212 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-82138b69-ef94-4493-9839-2b616ad47ebc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:53.393138 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-82138b69-ef94-4493-9839-2b616ad47ebc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:53.393612 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-82138b69-ef94-4493-9839-2b616ad47ebc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:53.394038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-82138b69-ef94-4493-9839-2b616ad47ebc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:53.394756 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-82138b69-ef94-4493-9839-2b616ad47ebc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:53.395203 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-82138b69-ef94-4493-9839-2b616ad47ebc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:53.395615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-82138b69-ef94-4493-9839-2b616ad47ebc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:53.527116 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-82138b69-ef94-4493-9839-2b616ad47ebc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:53.537360 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-82138b69-ef94-4493-9839-2b616ad47ebc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:53.539023 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-82138b69-ef94-4493-9839-2b616ad47ebc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:53.540298 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-82138b69-ef94-4493-9839-2b616ad47ebc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.158015 Oct 24 13:30:53.547743 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 338/676] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:53 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:54.567077 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-1ced7515-8fa7-4a94-abda-0db89e6c88a3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:54.567661 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-1ced7515-8fa7-4a94-abda-0db89e6c88a3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:54.574330 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ced7515-8fa7-4a94-abda-0db89e6c88a3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:54.574810 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ced7515-8fa7-4a94-abda-0db89e6c88a3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:54.575268 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ced7515-8fa7-4a94-abda-0db89e6c88a3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:54.576214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ced7515-8fa7-4a94-abda-0db89e6c88a3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:54.576697 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ced7515-8fa7-4a94-abda-0db89e6c88a3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:54.577120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ced7515-8fa7-4a94-abda-0db89e6c88a3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:54.706034 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1ced7515-8fa7-4a94-abda-0db89e6c88a3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:54.708931 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=82 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:54.716693 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1ced7515-8fa7-4a94-abda-0db89e6c88a3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:54.718118 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1ced7515-8fa7-4a94-abda-0db89e6c88a3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:54.719311 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-1ced7515-8fa7-4a94-abda-0db89e6c88a3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.156297 Oct 24 13:30:54.719865 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 339/677] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:54 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:55.745698 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5e35d807-d0a0-4832-9851-bba616234618 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:55.746312 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5e35d807-d0a0-4832-9851-bba616234618 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:55.752769 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e35d807-d0a0-4832-9851-bba616234618 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:55.753243 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e35d807-d0a0-4832-9851-bba616234618 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:55.753676 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e35d807-d0a0-4832-9851-bba616234618 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:55.754359 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e35d807-d0a0-4832-9851-bba616234618 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:55.754803 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e35d807-d0a0-4832-9851-bba616234618 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:55.755212 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e35d807-d0a0-4832-9851-bba616234618 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:55.757815 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:55.884358 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5e35d807-d0a0-4832-9851-bba616234618 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:55.892913 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5e35d807-d0a0-4832-9851-bba616234618 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:55.894331 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5e35d807-d0a0-4832-9851-bba616234618 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:55.895472 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5e35d807-d0a0-4832-9851-bba616234618 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.153821 Oct 24 13:30:55.896029 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 339/678] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:55 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:56.921456 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-73d559fc-65db-4500-8b2f-9cb6b7d6de47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:56.922057 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-73d559fc-65db-4500-8b2f-9cb6b7d6de47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:56.928974 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-73d559fc-65db-4500-8b2f-9cb6b7d6de47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:56.929443 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-73d559fc-65db-4500-8b2f-9cb6b7d6de47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:56.929864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-73d559fc-65db-4500-8b2f-9cb6b7d6de47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:56.930533 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-73d559fc-65db-4500-8b2f-9cb6b7d6de47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:56.930971 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-73d559fc-65db-4500-8b2f-9cb6b7d6de47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:56.931380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-73d559fc-65db-4500-8b2f-9cb6b7d6de47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:57.056413 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-73d559fc-65db-4500-8b2f-9cb6b7d6de47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:57.064880 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-73d559fc-65db-4500-8b2f-9cb6b7d6de47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:57.066293 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-73d559fc-65db-4500-8b2f-9cb6b7d6de47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:57.068099 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-73d559fc-65db-4500-8b2f-9cb6b7d6de47 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.150909 Oct 24 13:30:57.068680 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 340/679] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:56 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:58.093827 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-000285ba-169f-4498-8cd6-72ae4f7ccffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:58.094486 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-000285ba-169f-4498-8cd6-72ae4f7ccffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:58.096830 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=28 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:30:58.102048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-000285ba-169f-4498-8cd6-72ae4f7ccffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:58.102519 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-000285ba-169f-4498-8cd6-72ae4f7ccffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:58.102950 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-000285ba-169f-4498-8cd6-72ae4f7ccffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:58.103625 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-000285ba-169f-4498-8cd6-72ae4f7ccffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:58.104069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-000285ba-169f-4498-8cd6-72ae4f7ccffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:58.104508 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-000285ba-169f-4498-8cd6-72ae4f7ccffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:58.233215 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-000285ba-169f-4498-8cd6-72ae4f7ccffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:58.242337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-000285ba-169f-4498-8cd6-72ae4f7ccffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:58.243824 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-000285ba-169f-4498-8cd6-72ae4f7ccffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:58.245046 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-000285ba-169f-4498-8cd6-72ae4f7ccffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.155312 Oct 24 13:30:58.245601 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 340/680] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:58 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:30:59.270419 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-22ddc534-eede-4f13-8ff7-8b1ea1433248 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:30:59.271016 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-22ddc534-eede-4f13-8ff7-8b1ea1433248 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:30:59.277605 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-22ddc534-eede-4f13-8ff7-8b1ea1433248 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:59.278073 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-22ddc534-eede-4f13-8ff7-8b1ea1433248 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:59.278609 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-22ddc534-eede-4f13-8ff7-8b1ea1433248 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:59.279283 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-22ddc534-eede-4f13-8ff7-8b1ea1433248 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:30:59.279725 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-22ddc534-eede-4f13-8ff7-8b1ea1433248 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:30:59.280137 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-22ddc534-eede-4f13-8ff7-8b1ea1433248 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:30:59.406371 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-22ddc534-eede-4f13-8ff7-8b1ea1433248 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:59.415436 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-22ddc534-eede-4f13-8ff7-8b1ea1433248 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:59.416896 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-22ddc534-eede-4f13-8ff7-8b1ea1433248 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:30:59.418039 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-22ddc534-eede-4f13-8ff7-8b1ea1433248 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.151490 Oct 24 13:30:59.418593 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 341/681] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:30:59 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:31:00.444507 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-89ba3779-44d2-4557-8612-8ec2e9f89db5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:00.445114 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-89ba3779-44d2-4557-8612-8ec2e9f89db5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:00.451798 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-89ba3779-44d2-4557-8612-8ec2e9f89db5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:00.452294 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-89ba3779-44d2-4557-8612-8ec2e9f89db5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:00.452718 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-89ba3779-44d2-4557-8612-8ec2e9f89db5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:00.453391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-89ba3779-44d2-4557-8612-8ec2e9f89db5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:00.453836 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-89ba3779-44d2-4557-8612-8ec2e9f89db5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:00.454251 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-89ba3779-44d2-4557-8612-8ec2e9f89db5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:00.588255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-89ba3779-44d2-4557-8612-8ec2e9f89db5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:00.597100 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-89ba3779-44d2-4557-8612-8ec2e9f89db5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:00.598593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-89ba3779-44d2-4557-8612-8ec2e9f89db5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:00.599742 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-89ba3779-44d2-4557-8612-8ec2e9f89db5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.159672 Oct 24 13:31:00.600316 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 341/682] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:31:00 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:31:01.625489 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-becee792-346b-4d7c-b5b3-4923f045b8ab tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:01.626091 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-becee792-346b-4d7c-b5b3-4923f045b8ab tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:01.632969 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-becee792-346b-4d7c-b5b3-4923f045b8ab tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:01.633439 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-becee792-346b-4d7c-b5b3-4923f045b8ab tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:01.633858 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-becee792-346b-4d7c-b5b3-4923f045b8ab tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:01.634563 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-becee792-346b-4d7c-b5b3-4923f045b8ab tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:01.635382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-becee792-346b-4d7c-b5b3-4923f045b8ab tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:01.635797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-becee792-346b-4d7c-b5b3-4923f045b8ab tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:01.764879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-becee792-346b-4d7c-b5b3-4923f045b8ab tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:01.773404 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-becee792-346b-4d7c-b5b3-4923f045b8ab tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:01.774821 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-becee792-346b-4d7c-b5b3-4923f045b8ab tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:01.775971 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-becee792-346b-4d7c-b5b3-4923f045b8ab tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.154254 Oct 24 13:31:01.776570 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 342/683] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:31:01 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:31:02.802278 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f26a9aa9-2b5e-4bb2-bf15-a7ab39d780fc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:02.802812 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f26a9aa9-2b5e-4bb2-bf15-a7ab39d780fc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:02.809179 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f26a9aa9-2b5e-4bb2-bf15-a7ab39d780fc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:02.809658 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f26a9aa9-2b5e-4bb2-bf15-a7ab39d780fc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:02.810086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f26a9aa9-2b5e-4bb2-bf15-a7ab39d780fc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:02.810769 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f26a9aa9-2b5e-4bb2-bf15-a7ab39d780fc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:02.811217 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f26a9aa9-2b5e-4bb2-bf15-a7ab39d780fc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:02.811634 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f26a9aa9-2b5e-4bb2-bf15-a7ab39d780fc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:02.937215 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f26a9aa9-2b5e-4bb2-bf15-a7ab39d780fc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:02.946226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f26a9aa9-2b5e-4bb2-bf15-a7ab39d780fc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:02.947642 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f26a9aa9-2b5e-4bb2-bf15-a7ab39d780fc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:02.948868 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f26a9aa9-2b5e-4bb2-bf15-a7ab39d780fc tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.150997 Oct 24 13:31:02.949432 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 342/684] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:31:02 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:31:03.974620 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f344da67-92b3-4945-97cb-d58fbdd799f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:03.975222 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f344da67-92b3-4945-97cb-d58fbdd799f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:03.981592 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f344da67-92b3-4945-97cb-d58fbdd799f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:03.982061 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f344da67-92b3-4945-97cb-d58fbdd799f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:03.982485 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f344da67-92b3-4945-97cb-d58fbdd799f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:03.983155 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f344da67-92b3-4945-97cb-d58fbdd799f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:03.983598 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f344da67-92b3-4945-97cb-d58fbdd799f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:03.984007 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f344da67-92b3-4945-97cb-d58fbdd799f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:04.111177 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f344da67-92b3-4945-97cb-d58fbdd799f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:04.119895 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f344da67-92b3-4945-97cb-d58fbdd799f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:04.121352 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f344da67-92b3-4945-97cb-d58fbdd799f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:04.122530 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f344da67-92b3-4945-97cb-d58fbdd799f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.151857 Oct 24 13:31:04.125455 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 343/685] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:31:03 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:31:04.805154 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-41e3ea33-3b4a-4f1e-bb09-b8657b9c3be0 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:04.805647 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-41e3ea33-3b4a-4f1e-bb09-b8657b9c3be0 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:04.811907 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-41e3ea33-3b4a-4f1e-bb09-b8657b9c3be0 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:04.812423 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-41e3ea33-3b4a-4f1e-bb09-b8657b9c3be0 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:04.812855 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-41e3ea33-3b4a-4f1e-bb09-b8657b9c3be0 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:04.813541 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-41e3ea33-3b4a-4f1e-bb09-b8657b9c3be0 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:04.813998 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-41e3ea33-3b4a-4f1e-bb09-b8657b9c3be0 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:04.814410 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-41e3ea33-3b4a-4f1e-bb09-b8657b9c3be0 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:04.839799 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-41e3ea33-3b4a-4f1e-bb09-b8657b9c3be0 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Going to try to terminate instance {{(pid=119146) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:31:05.087250 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-41e3ea33-3b4a-4f1e-bb09-b8657b9c3be0 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "DELETE /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 204 len: 0 microversion: 2.1 time: 0.286315 Oct 24 13:31:05.088065 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 343/686] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:31:04 2022] DELETE /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:31:05.096699 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8057a42c-cca3-4b5d-b03d-dbeb88ce17f8 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:05.097329 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-8057a42c-cca3-4b5d-b03d-dbeb88ce17f8 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:05.104539 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8057a42c-cca3-4b5d-b03d-dbeb88ce17f8 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:05.105007 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8057a42c-cca3-4b5d-b03d-dbeb88ce17f8 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:05.105427 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8057a42c-cca3-4b5d-b03d-dbeb88ce17f8 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:05.106097 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8057a42c-cca3-4b5d-b03d-dbeb88ce17f8 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:05.106569 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8057a42c-cca3-4b5d-b03d-dbeb88ce17f8 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:05.106978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8057a42c-cca3-4b5d-b03d-dbeb88ce17f8 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:05.149564 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7ca5cf21-4593-4534-be79-d8440f2d6a79 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:05.150298 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7ca5cf21-4593-4534-be79-d8440f2d6a79 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:05.156294 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ca5cf21-4593-4534-be79-d8440f2d6a79 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:05.156836 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ca5cf21-4593-4534-be79-d8440f2d6a79 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:05.157276 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ca5cf21-4593-4534-be79-d8440f2d6a79 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:05.157951 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ca5cf21-4593-4534-be79-d8440f2d6a79 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:05.158670 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ca5cf21-4593-4534-be79-d8440f2d6a79 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:05.159022 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ca5cf21-4593-4534-be79-d8440f2d6a79 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:05.299957 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7ca5cf21-4593-4534-be79-d8440f2d6a79 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:05.310626 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7ca5cf21-4593-4534-be79-d8440f2d6a79 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:05.311705 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7ca5cf21-4593-4534-be79-d8440f2d6a79 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:05.312934 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7ca5cf21-4593-4534-be79-d8440f2d6a79 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.168254 Oct 24 13:31:05.313608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 344/687] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:31:05 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:31:05.477340 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-8057a42c-cca3-4b5d-b03d-dbeb88ce17f8 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:05.486770 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-8057a42c-cca3-4b5d-b03d-dbeb88ce17f8 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1511 microversion: 2.1 time: 0.392929 Oct 24 13:31:05.486770 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 344/688] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:05 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1511 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:31:06.338974 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-6333ce19-4480-46ed-ae88-c11bf0f809f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:06.339587 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-6333ce19-4480-46ed-ae88-c11bf0f809f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:06.346242 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6333ce19-4480-46ed-ae88-c11bf0f809f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:06.346672 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6333ce19-4480-46ed-ae88-c11bf0f809f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:06.347141 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6333ce19-4480-46ed-ae88-c11bf0f809f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:06.348395 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6333ce19-4480-46ed-ae88-c11bf0f809f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:06.348850 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6333ce19-4480-46ed-ae88-c11bf0f809f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:06.349272 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6333ce19-4480-46ed-ae88-c11bf0f809f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:06.480866 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6333ce19-4480-46ed-ae88-c11bf0f809f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:06.506416 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6333ce19-4480-46ed-ae88-c11bf0f809f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:06.508085 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6333ce19-4480-46ed-ae88-c11bf0f809f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:06.509126 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6343e027-7a8c-45ab-8b4a-73458606d656 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:06.509589 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-6333ce19-4480-46ed-ae88-c11bf0f809f5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.174241 Oct 24 13:31:06.510015 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-6343e027-7a8c-45ab-8b4a-73458606d656 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:06.516485 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6343e027-7a8c-45ab-8b4a-73458606d656 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:06.517602 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6343e027-7a8c-45ab-8b4a-73458606d656 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:06.517602 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6343e027-7a8c-45ab-8b4a-73458606d656 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:06.518543 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6343e027-7a8c-45ab-8b4a-73458606d656 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:06.519101 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6343e027-7a8c-45ab-8b4a-73458606d656 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:06.520303 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6343e027-7a8c-45ab-8b4a-73458606d656 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:06.524464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 345/689] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:31:06 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:31:06.648684 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-6343e027-7a8c-45ab-8b4a-73458606d656 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:06.656421 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6343e027-7a8c-45ab-8b4a-73458606d656 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1511 microversion: 2.1 time: 0.151423 Oct 24 13:31:06.656993 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 345/690] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:06 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:31:07.535579 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-de595309-2890-4d2b-808f-d5d0b1338dc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:07.536135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-de595309-2890-4d2b-808f-d5d0b1338dc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:07.542371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-de595309-2890-4d2b-808f-d5d0b1338dc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:07.542844 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-de595309-2890-4d2b-808f-d5d0b1338dc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:07.543268 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-de595309-2890-4d2b-808f-d5d0b1338dc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:07.543948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-de595309-2890-4d2b-808f-d5d0b1338dc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:07.544413 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-de595309-2890-4d2b-808f-d5d0b1338dc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:07.544829 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-de595309-2890-4d2b-808f-d5d0b1338dc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:07.669740 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-de595309-2890-4d2b-808f-d5d0b1338dc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:07.678971 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-de595309-2890-4d2b-808f-d5d0b1338dc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:07.680432 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-de595309-2890-4d2b-808f-d5d0b1338dc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:07.680580 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-cc4ccbc0-37c7-4f25-8d64-b2d279bce72d tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:07.681161 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-cc4ccbc0-37c7-4f25-8d64-b2d279bce72d tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:07.681588 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-de595309-2890-4d2b-808f-d5d0b1338dc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.149973 Oct 24 13:31:07.682138 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 346/691] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:31:07 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:31:07.687647 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cc4ccbc0-37c7-4f25-8d64-b2d279bce72d tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:07.688121 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cc4ccbc0-37c7-4f25-8d64-b2d279bce72d tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:07.688584 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cc4ccbc0-37c7-4f25-8d64-b2d279bce72d tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:07.689262 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cc4ccbc0-37c7-4f25-8d64-b2d279bce72d tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:07.689706 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cc4ccbc0-37c7-4f25-8d64-b2d279bce72d tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:07.690121 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cc4ccbc0-37c7-4f25-8d64-b2d279bce72d tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:07.818493 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-cc4ccbc0-37c7-4f25-8d64-b2d279bce72d tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:07.826427 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-cc4ccbc0-37c7-4f25-8d64-b2d279bce72d tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1511 microversion: 2.1 time: 0.150176 Oct 24 13:31:07.826996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 346/692] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:07 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:31:08.707860 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-935ee4fc-cb23-434c-aeaa-59342085cdee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:08.708496 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-935ee4fc-cb23-434c-aeaa-59342085cdee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:08.714844 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-935ee4fc-cb23-434c-aeaa-59342085cdee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:08.715316 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-935ee4fc-cb23-434c-aeaa-59342085cdee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:08.715739 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-935ee4fc-cb23-434c-aeaa-59342085cdee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:08.716449 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-935ee4fc-cb23-434c-aeaa-59342085cdee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:08.716899 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-935ee4fc-cb23-434c-aeaa-59342085cdee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:08.717314 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-935ee4fc-cb23-434c-aeaa-59342085cdee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:08.845308 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-935ee4fc-cb23-434c-aeaa-59342085cdee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:08.848981 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b520e2fd-0809-48d3-a63f-7663b7b4e9bf tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:08.849592 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b520e2fd-0809-48d3-a63f-7663b7b4e9bf tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:08.853887 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-935ee4fc-cb23-434c-aeaa-59342085cdee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:08.855308 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-935ee4fc-cb23-434c-aeaa-59342085cdee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:08.855558 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b520e2fd-0809-48d3-a63f-7663b7b4e9bf tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:08.856032 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b520e2fd-0809-48d3-a63f-7663b7b4e9bf tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:08.856490 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-935ee4fc-cb23-434c-aeaa-59342085cdee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.153172 Oct 24 13:31:08.856613 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b520e2fd-0809-48d3-a63f-7663b7b4e9bf tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:08.857108 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 347/693] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:31:08 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:31:08.857216 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b520e2fd-0809-48d3-a63f-7663b7b4e9bf tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:08.857598 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b520e2fd-0809-48d3-a63f-7663b7b4e9bf tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:08.858014 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b520e2fd-0809-48d3-a63f-7663b7b4e9bf tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:08.984397 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b520e2fd-0809-48d3-a63f-7663b7b4e9bf tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:08.991982 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b520e2fd-0809-48d3-a63f-7663b7b4e9bf tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1511 microversion: 2.1 time: 0.146697 Oct 24 13:31:08.992573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 347/694] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:08 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1511 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:31:09.882945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3b55c290-12cc-4c78-8271-6ff8865e2672 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:09.883569 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-3b55c290-12cc-4c78-8271-6ff8865e2672 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:09.889939 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3b55c290-12cc-4c78-8271-6ff8865e2672 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:09.890418 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3b55c290-12cc-4c78-8271-6ff8865e2672 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:09.890847 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3b55c290-12cc-4c78-8271-6ff8865e2672 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:09.891531 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3b55c290-12cc-4c78-8271-6ff8865e2672 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:09.891986 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3b55c290-12cc-4c78-8271-6ff8865e2672 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:09.892442 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3b55c290-12cc-4c78-8271-6ff8865e2672 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:10.014870 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-beb18720-2c52-48e7-8b57-ef9dc6bc6e22 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:10.015475 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-beb18720-2c52-48e7-8b57-ef9dc6bc6e22 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:10.020290 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3b55c290-12cc-4c78-8271-6ff8865e2672 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:10.022534 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-beb18720-2c52-48e7-8b57-ef9dc6bc6e22 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:10.023009 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-beb18720-2c52-48e7-8b57-ef9dc6bc6e22 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:10.023446 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-beb18720-2c52-48e7-8b57-ef9dc6bc6e22 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:10.024129 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-beb18720-2c52-48e7-8b57-ef9dc6bc6e22 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:10.024606 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-beb18720-2c52-48e7-8b57-ef9dc6bc6e22 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:10.025023 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-beb18720-2c52-48e7-8b57-ef9dc6bc6e22 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:10.028896 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3b55c290-12cc-4c78-8271-6ff8865e2672 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:10.030329 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3b55c290-12cc-4c78-8271-6ff8865e2672 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:10.031483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3b55c290-12cc-4c78-8271-6ff8865e2672 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.153029 Oct 24 13:31:10.032039 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 348/695] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:31:09 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:31:10.155445 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-beb18720-2c52-48e7-8b57-ef9dc6bc6e22 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:10.163836 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-beb18720-2c52-48e7-8b57-ef9dc6bc6e22 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1511 microversion: 2.1 time: 0.152708 Oct 24 13:31:10.164375 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 348/696] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:10 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:31:11.057486 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f83a2190-e729-45b6-897b-0f5d0fc47712 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:11.058084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f83a2190-e729-45b6-897b-0f5d0fc47712 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:11.064499 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f83a2190-e729-45b6-897b-0f5d0fc47712 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:11.064974 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f83a2190-e729-45b6-897b-0f5d0fc47712 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:11.065403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f83a2190-e729-45b6-897b-0f5d0fc47712 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:11.066078 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f83a2190-e729-45b6-897b-0f5d0fc47712 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:11.067177 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f83a2190-e729-45b6-897b-0f5d0fc47712 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:11.067600 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f83a2190-e729-45b6-897b-0f5d0fc47712 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:11.187476 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-36806a06-bdf0-4c48-854b-8939a49074f3 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:11.188106 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-36806a06-bdf0-4c48-854b-8939a49074f3 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:11.195038 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-36806a06-bdf0-4c48-854b-8939a49074f3 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:11.195318 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f83a2190-e729-45b6-897b-0f5d0fc47712 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:11.195512 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-36806a06-bdf0-4c48-854b-8939a49074f3 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:11.195939 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-36806a06-bdf0-4c48-854b-8939a49074f3 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:11.196653 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-36806a06-bdf0-4c48-854b-8939a49074f3 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:11.197103 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-36806a06-bdf0-4c48-854b-8939a49074f3 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:11.197525 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-36806a06-bdf0-4c48-854b-8939a49074f3 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:11.204523 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f83a2190-e729-45b6-897b-0f5d0fc47712 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:11.206013 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f83a2190-e729-45b6-897b-0f5d0fc47712 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:11.207237 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f83a2190-e729-45b6-897b-0f5d0fc47712 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.153717 Oct 24 13:31:11.207882 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 349/697] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:31:11 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:31:11.338822 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-36806a06-bdf0-4c48-854b-8939a49074f3 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:11.346542 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-36806a06-bdf0-4c48-854b-8939a49074f3 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1511 microversion: 2.1 time: 0.162948 Oct 24 13:31:11.347123 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 349/698] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:11 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:31:12.233162 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-946f8c99-fcfa-4eee-b140-65385bdcb85c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:12.233761 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-946f8c99-fcfa-4eee-b140-65385bdcb85c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:12.240152 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-946f8c99-fcfa-4eee-b140-65385bdcb85c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:12.240652 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-946f8c99-fcfa-4eee-b140-65385bdcb85c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:12.241076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-946f8c99-fcfa-4eee-b140-65385bdcb85c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:12.241742 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-946f8c99-fcfa-4eee-b140-65385bdcb85c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:12.242182 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-946f8c99-fcfa-4eee-b140-65385bdcb85c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:12.242595 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-946f8c99-fcfa-4eee-b140-65385bdcb85c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:12.369380 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-946f8c99-fcfa-4eee-b140-65385bdcb85c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:12.372029 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0bd34b4d-5bd8-4be9-b9cc-4beeadabd957 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:12.372678 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0bd34b4d-5bd8-4be9-b9cc-4beeadabd957 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:12.378133 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-946f8c99-fcfa-4eee-b140-65385bdcb85c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:12.378520 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0bd34b4d-5bd8-4be9-b9cc-4beeadabd957 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:12.379504 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0bd34b4d-5bd8-4be9-b9cc-4beeadabd957 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:12.380168 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0bd34b4d-5bd8-4be9-b9cc-4beeadabd957 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:12.380354 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-946f8c99-fcfa-4eee-b140-65385bdcb85c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:12.380869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0bd34b4d-5bd8-4be9-b9cc-4beeadabd957 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:12.381316 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0bd34b4d-5bd8-4be9-b9cc-4beeadabd957 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:12.381417 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-946f8c99-fcfa-4eee-b140-65385bdcb85c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.152116 Oct 24 13:31:12.381728 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0bd34b4d-5bd8-4be9-b9cc-4beeadabd957 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:12.381903 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 350/699] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:31:12 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:31:12.514628 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0bd34b4d-5bd8-4be9-b9cc-4beeadabd957 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:12.522522 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0bd34b4d-5bd8-4be9-b9cc-4beeadabd957 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1511 microversion: 2.1 time: 0.156644 Oct 24 13:31:12.523097 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 350/700] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:12 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:31:13.409859 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-33ce7d9c-05cd-4131-887b-d0189c4d7af4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:13.414209 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-33ce7d9c-05cd-4131-887b-d0189c4d7af4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:13.431664 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-33ce7d9c-05cd-4131-887b-d0189c4d7af4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:13.432134 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-33ce7d9c-05cd-4131-887b-d0189c4d7af4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:13.434581 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-33ce7d9c-05cd-4131-887b-d0189c4d7af4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:13.435559 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-33ce7d9c-05cd-4131-887b-d0189c4d7af4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:13.436503 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-33ce7d9c-05cd-4131-887b-d0189c4d7af4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:13.436594 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-33ce7d9c-05cd-4131-887b-d0189c4d7af4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:13.545665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9306ae4b-80e4-4193-945d-25dc1f9f7710 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:13.546270 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9306ae4b-80e4-4193-945d-25dc1f9f7710 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:13.554176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9306ae4b-80e4-4193-945d-25dc1f9f7710 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:13.554852 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9306ae4b-80e4-4193-945d-25dc1f9f7710 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:13.555480 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9306ae4b-80e4-4193-945d-25dc1f9f7710 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:13.556172 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9306ae4b-80e4-4193-945d-25dc1f9f7710 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:13.556678 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9306ae4b-80e4-4193-945d-25dc1f9f7710 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:13.557106 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9306ae4b-80e4-4193-945d-25dc1f9f7710 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:13.588169 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-33ce7d9c-05cd-4131-887b-d0189c4d7af4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:13.598282 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-33ce7d9c-05cd-4131-887b-d0189c4d7af4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:13.599609 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-33ce7d9c-05cd-4131-887b-d0189c4d7af4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:13.601590 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-33ce7d9c-05cd-4131-887b-d0189c4d7af4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.197007 Oct 24 13:31:13.602151 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 351/701] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:31:13 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:31:13.750616 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9306ae4b-80e4-4193-945d-25dc1f9f7710 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:13.759153 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9306ae4b-80e4-4193-945d-25dc1f9f7710 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1511 microversion: 2.1 time: 0.217283 Oct 24 13:31:13.760071 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 351/702] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:13 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1511 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:31:13.995628 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-e4d65a14-24ca-4dd7-b903-dfbf8ed98e93 req-f57d98d0-344c-44b7-be28-a747db4c2dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "045d0b97-923d-4969-a8f5-664dbc753b93", "name": "network-vif-deleted", "tag": "4be62649-dc27-4985-9ca2-ca391e7d9189"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:31:14.005708 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-e4d65a14-24ca-4dd7-b903-dfbf8ed98e93 req-f57d98d0-344c-44b7-be28-a747db4c2dd1 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:14.006180 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-e4d65a14-24ca-4dd7-b903-dfbf8ed98e93 req-f57d98d0-344c-44b7-be28-a747db4c2dd1 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:14.006608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-e4d65a14-24ca-4dd7-b903-dfbf8ed98e93 req-f57d98d0-344c-44b7-be28-a747db4c2dd1 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:14.018056 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-e4d65a14-24ca-4dd7-b903-dfbf8ed98e93 req-f57d98d0-344c-44b7-be28-a747db4c2dd1 service nova] Creating event network-vif-deleted:4be62649-dc27-4985-9ca2-ca391e7d9189 for instance 045d0b97-923d-4969-a8f5-664dbc753b93 on hv-cinder-86249 Oct 24 13:31:14.024199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-e4d65a14-24ca-4dd7-b903-dfbf8ed98e93 req-f57d98d0-344c-44b7-be28-a747db4c2dd1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091299 Oct 24 13:31:14.024871 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 352/703] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:31:14.230141 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-1cfb03ae-ced5-4fe9-a31f-05f4bfd0313a req-bb50388d-9fb7-4d5e-837c-c641e05d40a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d04bbb-034d-4cf1-a753-9c4cb48e92bd", "name": "network-vif-plugged", "status": "completed", "tag": "4dfc7079-30d9-488d-9dfc-1df75d250b32"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:31:14.240662 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-1cfb03ae-ced5-4fe9-a31f-05f4bfd0313a req-bb50388d-9fb7-4d5e-837c-c641e05d40a3 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:14.241128 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-1cfb03ae-ced5-4fe9-a31f-05f4bfd0313a req-bb50388d-9fb7-4d5e-837c-c641e05d40a3 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:14.244146 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-1cfb03ae-ced5-4fe9-a31f-05f4bfd0313a req-bb50388d-9fb7-4d5e-837c-c641e05d40a3 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:14.252625 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-1cfb03ae-ced5-4fe9-a31f-05f4bfd0313a req-bb50388d-9fb7-4d5e-837c-c641e05d40a3 service nova] Creating event network-vif-plugged:4dfc7079-30d9-488d-9dfc-1df75d250b32 for instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd on hv-cinder-86249 Oct 24 13:31:14.257568 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-1cfb03ae-ced5-4fe9-a31f-05f4bfd0313a req-bb50388d-9fb7-4d5e-837c-c641e05d40a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032223 Oct 24 13:31:14.258229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 352/704] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:31:14.627980 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f844ed12-fc52-4c9b-a323-a9f532c3ad74 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:14.628674 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f844ed12-fc52-4c9b-a323-a9f532c3ad74 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:14.635211 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f844ed12-fc52-4c9b-a323-a9f532c3ad74 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:14.635681 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f844ed12-fc52-4c9b-a323-a9f532c3ad74 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:14.637251 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f844ed12-fc52-4c9b-a323-a9f532c3ad74 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:14.637251 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f844ed12-fc52-4c9b-a323-a9f532c3ad74 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:14.637251 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f844ed12-fc52-4c9b-a323-a9f532c3ad74 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:14.637660 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f844ed12-fc52-4c9b-a323-a9f532c3ad74 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:14.782138 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f844ed12-fc52-4c9b-a323-a9f532c3ad74 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:14.784034 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f395c223-00eb-44c3-9c5c-e12d43d8b9fb tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:14.784922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f395c223-00eb-44c3-9c5c-e12d43d8b9fb tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:14.792189 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f844ed12-fc52-4c9b-a323-a9f532c3ad74 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:14.792871 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f395c223-00eb-44c3-9c5c-e12d43d8b9fb tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:14.804458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f395c223-00eb-44c3-9c5c-e12d43d8b9fb tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:14.804644 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f844ed12-fc52-4c9b-a323-a9f532c3ad74 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:14.804769 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f395c223-00eb-44c3-9c5c-e12d43d8b9fb tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:14.804769 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f395c223-00eb-44c3-9c5c-e12d43d8b9fb tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:14.804943 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f844ed12-fc52-4c9b-a323-a9f532c3ad74 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.171693 Oct 24 13:31:14.805045 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f395c223-00eb-44c3-9c5c-e12d43d8b9fb tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:14.805153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 353/705] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:31:14 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:31:14.805252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f395c223-00eb-44c3-9c5c-e12d43d8b9fb tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:14.831942 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f395c223-00eb-44c3-9c5c-e12d43d8b9fb tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:14.833388 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f395c223-00eb-44c3-9c5c-e12d43d8b9fb tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:14.833822 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f395c223-00eb-44c3-9c5c-e12d43d8b9fb tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:14.834261 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.objects.instance [None req-f395c223-00eb-44c3-9c5c-e12d43d8b9fb tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lazy-loading 'fault' on Instance uuid 045d0b97-923d-4969-a8f5-664dbc753b93 {{(pid=119145) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:31:14.886049 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f395c223-00eb-44c3-9c5c-e12d43d8b9fb tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:14.889378 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f395c223-00eb-44c3-9c5c-e12d43d8b9fb tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 200 len: 1306 microversion: 2.1 time: 0.110192 Oct 24 13:31:14.889932 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 353/706] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:14 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 1306 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:31:15.821925 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b2b3a078-9d9c-460a-a4c0-0823486bf607 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:15.822479 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b2b3a078-9d9c-460a-a4c0-0823486bf607 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:15.829466 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2b3a078-9d9c-460a-a4c0-0823486bf607 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:15.829943 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2b3a078-9d9c-460a-a4c0-0823486bf607 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:15.830368 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2b3a078-9d9c-460a-a4c0-0823486bf607 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:15.831046 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2b3a078-9d9c-460a-a4c0-0823486bf607 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:15.831495 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2b3a078-9d9c-460a-a4c0-0823486bf607 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:15.831909 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2b3a078-9d9c-460a-a4c0-0823486bf607 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:15.913829 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6147992e-7d8a-4db7-b1cf-4c0e1460770b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:15.914470 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-6147992e-7d8a-4db7-b1cf-4c0e1460770b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: 045d0b97-923d-4969-a8f5-664dbc753b93] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:15.921062 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6147992e-7d8a-4db7-b1cf-4c0e1460770b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:15.921532 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6147992e-7d8a-4db7-b1cf-4c0e1460770b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:15.921963 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6147992e-7d8a-4db7-b1cf-4c0e1460770b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:15.922644 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6147992e-7d8a-4db7-b1cf-4c0e1460770b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:15.923091 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6147992e-7d8a-4db7-b1cf-4c0e1460770b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:15.923567 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6147992e-7d8a-4db7-b1cf-4c0e1460770b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:15.938814 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-6147992e-7d8a-4db7-b1cf-4c0e1460770b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] HTTP exception thrown: Instance 045d0b97-923d-4969-a8f5-664dbc753b93 could not be found. Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6147992e-7d8a-4db7-b1cf-4c0e1460770b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Request method failure captured: Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 HTTP/1.1 Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpMgFEr-fCUWzoASLJGX21zHASG1ljWv1VWajLzZ6JWsqVFAUqNvpryKHLsXO0WdvnG9_YYXNT_J9iCGLMewjRMzA_8ojfDeSv_iyA_rw5LBt_-QqbSZWQc37Ohr8rFskYtmrvtTVofUhmvxS7wfA_nqA_ddMkklrpQWLtMBYEdqYgM Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: ca3097281d4c43458b408414648233a0 Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-VolumesSnapshotTestJSON-428204675 Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:31:15.940458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:31:15.942329 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca3097281d4c43458b408414648233a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca3097281d4c43458b408414648233a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca3097281d4c43458b408414648233a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca3097281d4c43458b408414648233a0"}]}] Oct 24 13:31:15.942329 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-VolumesSnapshotTestJSON-428204675 Oct 24 13:31:15.942329 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: ca3097281d4c43458b408414648233a0 Oct 24 13:31:15.942329 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-428204675 Oct 24 13:31:15.942329 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-VolumesSnapshotTestJSON-428204675-project Oct 24 13:31:15.942329 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:31:15.942329 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:31:15.942329 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 315f9ad503b8402090faac7b827b5463 Oct 24 13:31:15.942329 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-VolumesSnapshotTestJSON-428204675-project Oct 24 13:31:15.942329 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:31:15.942329 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance 045d0b97-923d-4969-a8f5-664dbc753b93 could not be found. Oct 24 13:31:15.942329 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': '045d0b97-923d-4969-a8f5-664dbc753b93'} Oct 24 13:31:15.943135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:31:15.943135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:31:15.943135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:31:15.943135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:31:15.943135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:31:15.943135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:31:15.943135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:31:15.943135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:31:15.943135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:31:15.943135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:31:15.943135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 045d0b97-923d-4969-a8f5-664dbc753b93 could not be found. Oct 24 13:31:15.943135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:31:15.943135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:31:15.943135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:31:15.943135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:31:15.943135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:31:15.943135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:31:15.943135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:31:15.943135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:31:15.943135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:31:15.944403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:31:15.944403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:31:15.944403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:31:15.944403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:31:15.944403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:31:15.944403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:31:15.944403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:31:15.944403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 045d0b97-923d-4969-a8f5-664dbc753b93 could not be found. Oct 24 13:31:15.944403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:31:15.944403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:31:15.944403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:31:15.944403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:31:15.944403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:31:15.944403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:31:15.944403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:31:15.944403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:31:15.944403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 045d0b97-923d-4969-a8f5-664dbc753b93 could not be found. Oct 24 13:31:15.944403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:31:15.945580 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6147992e-7d8a-4db7-b1cf-4c0e1460770b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Returning 404 to user: Instance 045d0b97-923d-4969-a8f5-664dbc753b93 could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:31:15.945580 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6147992e-7d8a-4db7-b1cf-4c0e1460770b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93" status: 404 len: 111 microversion: 2.1 time: 0.032390 Oct 24 13:31:15.945580 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 354/707] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:15 2022] GET /compute/v2.1/servers/045d0b97-923d-4969-a8f5-664dbc753b93 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:31:15.959671 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b2b3a078-9d9c-460a-a4c0-0823486bf607 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:15.962279 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:15.970736 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b2b3a078-9d9c-460a-a4c0-0823486bf607 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:15.973817 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b2b3a078-9d9c-460a-a4c0-0823486bf607 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:15.973817 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b2b3a078-9d9c-460a-a4c0-0823486bf607 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.155442 Oct 24 13:31:15.976156 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 354/708] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:31:15 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:31:16.997746 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-088ffcf6-b876-4139-9223-ecad71374765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:16.998373 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-088ffcf6-b876-4139-9223-ecad71374765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:17.004855 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-088ffcf6-b876-4139-9223-ecad71374765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:17.005323 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-088ffcf6-b876-4139-9223-ecad71374765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:17.005742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-088ffcf6-b876-4139-9223-ecad71374765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:17.010058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-088ffcf6-b876-4139-9223-ecad71374765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:17.010058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-088ffcf6-b876-4139-9223-ecad71374765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:17.010058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-088ffcf6-b876-4139-9223-ecad71374765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:17.138233 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-088ffcf6-b876-4139-9223-ecad71374765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:17.147574 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-088ffcf6-b876-4139-9223-ecad71374765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:17.149027 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-088ffcf6-b876-4139-9223-ecad71374765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:17.153445 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-088ffcf6-b876-4139-9223-ecad71374765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.156235 Oct 24 13:31:17.153445 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 355/709] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:31:16 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:31:18.176181 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-37fe74d8-be89-443f-935b-fb1f0e4deeb4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:18.177407 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-37fe74d8-be89-443f-935b-fb1f0e4deeb4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:18.184436 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-37fe74d8-be89-443f-935b-fb1f0e4deeb4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:18.184922 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-37fe74d8-be89-443f-935b-fb1f0e4deeb4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:18.185352 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-37fe74d8-be89-443f-935b-fb1f0e4deeb4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:18.186031 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-37fe74d8-be89-443f-935b-fb1f0e4deeb4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:18.186478 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-37fe74d8-be89-443f-935b-fb1f0e4deeb4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:18.186896 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-37fe74d8-be89-443f-935b-fb1f0e4deeb4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:18.317303 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-37fe74d8-be89-443f-935b-fb1f0e4deeb4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:18.325901 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-37fe74d8-be89-443f-935b-fb1f0e4deeb4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:18.327310 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-37fe74d8-be89-443f-935b-fb1f0e4deeb4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:18.328473 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-37fe74d8-be89-443f-935b-fb1f0e4deeb4 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.156131 Oct 24 13:31:18.329033 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 355/710] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:31:18 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:31:19.354313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-42b61f4d-8212-42ba-97b1-0da07b657eba tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:19.354838 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-42b61f4d-8212-42ba-97b1-0da07b657eba tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:19.361272 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-42b61f4d-8212-42ba-97b1-0da07b657eba tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:19.361743 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-42b61f4d-8212-42ba-97b1-0da07b657eba tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:19.362193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-42b61f4d-8212-42ba-97b1-0da07b657eba tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:19.362862 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-42b61f4d-8212-42ba-97b1-0da07b657eba tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:19.363307 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-42b61f4d-8212-42ba-97b1-0da07b657eba tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:19.363720 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-42b61f4d-8212-42ba-97b1-0da07b657eba tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:19.491976 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-42b61f4d-8212-42ba-97b1-0da07b657eba tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:19.500508 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-42b61f4d-8212-42ba-97b1-0da07b657eba tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:19.501930 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-42b61f4d-8212-42ba-97b1-0da07b657eba tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:19.503074 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-42b61f4d-8212-42ba-97b1-0da07b657eba tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.152808 Oct 24 13:31:19.503629 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 356/711] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:31:19 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:31:20.528770 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bd318c08-ccc7-43ac-b795-d4550ed7f5c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:20.529372 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bd318c08-ccc7-43ac-b795-d4550ed7f5c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:20.535661 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bd318c08-ccc7-43ac-b795-d4550ed7f5c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:20.536728 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bd318c08-ccc7-43ac-b795-d4550ed7f5c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:20.537159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bd318c08-ccc7-43ac-b795-d4550ed7f5c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:20.537830 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bd318c08-ccc7-43ac-b795-d4550ed7f5c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:20.538273 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bd318c08-ccc7-43ac-b795-d4550ed7f5c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:20.538686 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bd318c08-ccc7-43ac-b795-d4550ed7f5c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:20.666182 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-bd318c08-ccc7-43ac-b795-d4550ed7f5c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:20.674676 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-bd318c08-ccc7-43ac-b795-d4550ed7f5c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:20.676086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-bd318c08-ccc7-43ac-b795-d4550ed7f5c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:20.677885 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-bd318c08-ccc7-43ac-b795-d4550ed7f5c7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1806 microversion: 2.20 time: 0.152919 Oct 24 13:31:20.678439 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 356/712] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:31:20 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:31:21.703663 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ff1d6adb-08d7-4546-8842-2e6174259d51 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:21.704263 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ff1d6adb-08d7-4546-8842-2e6174259d51 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:21.706406 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=44 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:21.711230 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ff1d6adb-08d7-4546-8842-2e6174259d51 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:21.711704 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ff1d6adb-08d7-4546-8842-2e6174259d51 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:21.712129 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ff1d6adb-08d7-4546-8842-2e6174259d51 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:21.712831 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ff1d6adb-08d7-4546-8842-2e6174259d51 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:21.716484 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ff1d6adb-08d7-4546-8842-2e6174259d51 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:21.716484 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ff1d6adb-08d7-4546-8842-2e6174259d51 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:21.728360 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=100 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:21.860602 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ff1d6adb-08d7-4546-8842-2e6174259d51 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:21.870592 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ff1d6adb-08d7-4546-8842-2e6174259d51 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:21.872086 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ff1d6adb-08d7-4546-8842-2e6174259d51 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:21.873398 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ff1d6adb-08d7-4546-8842-2e6174259d51 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1793 microversion: 2.20 time: 0.174203 Oct 24 13:31:21.873983 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 357/713] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:31:21 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1793 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:31:28.555947 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5d754df8-a87b-44e7-b664-c093930817bd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1318380173", "imageRef": "1a874490-179e-412c-895e-52b16935c04c", "flavorRef": "452", "networks": [{"uuid": "ecd23e7e-0b9d-4b8b-a6ad-089c005916e2"}]}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:31:28.564621 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:28.612749 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.network.neutron [None req-5d754df8-a87b-44e7-b664-c093930817bd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] validate_networks() for [('ecd23e7e-0b9d-4b8b-a6ad-089c005916e2', None, None, None, None, None)] {{(pid=119146) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:31:29.042564 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-5d754df8-a87b-44e7-b664-c093930817bd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Flavor limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:31:29.042976 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-5d754df8-a87b-44e7-b664-c093930817bd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Image limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:31:29.043440 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-5d754df8-a87b-44e7-b664-c093930817bd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Flavor pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:31:29.043842 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-5d754df8-a87b-44e7-b664-c093930817bd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Image pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:31:29.044398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-5d754df8-a87b-44e7-b664-c093930817bd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:31:29.053040 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5d754df8-a87b-44e7-b664-c093930817bd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:29.053514 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5d754df8-a87b-44e7-b664-c093930817bd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:29.053941 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5d754df8-a87b-44e7-b664-c093930817bd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:29.054682 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5d754df8-a87b-44e7-b664-c093930817bd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:29.055636 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5d754df8-a87b-44e7-b664-c093930817bd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:29.056053 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5d754df8-a87b-44e7-b664-c093930817bd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:29.072918 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-5d754df8-a87b-44e7-b664-c093930817bd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Getting quotas for project ca3097281d4c43458b408414648233a0. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:31:29.078162 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-5d754df8-a87b-44e7-b664-c093930817bd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Getting quotas for user 315f9ad503b8402090faac7b827b5463 and project ca3097281d4c43458b408414648233a0. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:31:29.089598 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5d754df8-a87b-44e7-b664-c093930817bd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Going to run 1 instances... {{(pid=119146) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:31:29.091940 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5d754df8-a87b-44e7-b664-c093930817bd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a874490-179e-412c-895e-52b16935c04c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119146) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:31:29.210075 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5d754df8-a87b-44e7-b664-c093930817bd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658100 Oct 24 13:31:29.210732 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 357/714] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 24 13:31:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:31:29.221614 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ef89caed-908e-44eb-a8ad-c40a2c93a106 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:29.222216 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ef89caed-908e-44eb-a8ad-c40a2c93a106 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:29.276916 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ef89caed-908e-44eb-a8ad-c40a2c93a106 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:29.285345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ef89caed-908e-44eb-a8ad-c40a2c93a106 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b" status: 200 len: 1219 microversion: 2.1 time: 0.067493 Oct 24 13:31:29.285920 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 358/715] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:29 2022] GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:31:30.309298 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-52d8863c-5a38-4ad9-a5a8-85752164da58 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:30.309911 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-52d8863c-5a38-4ad9-a5a8-85752164da58 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:30.316480 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-52d8863c-5a38-4ad9-a5a8-85752164da58 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:30.316958 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-52d8863c-5a38-4ad9-a5a8-85752164da58 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:30.319378 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-52d8863c-5a38-4ad9-a5a8-85752164da58 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:30.319378 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-52d8863c-5a38-4ad9-a5a8-85752164da58 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:30.319378 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-52d8863c-5a38-4ad9-a5a8-85752164da58 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:30.319378 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-52d8863c-5a38-4ad9-a5a8-85752164da58 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:30.381401 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-52d8863c-5a38-4ad9-a5a8-85752164da58 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:30.389498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-52d8863c-5a38-4ad9-a5a8-85752164da58 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b" status: 200 len: 1223 microversion: 2.1 time: 0.084538 Oct 24 13:31:30.390079 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 358/716] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:30 2022] GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:31:31.413448 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-fef5dbe9-4562-4882-a09b-e34954e6b992 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:31.414184 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-fef5dbe9-4562-4882-a09b-e34954e6b992 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:31.421918 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fef5dbe9-4562-4882-a09b-e34954e6b992 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:31.423747 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fef5dbe9-4562-4882-a09b-e34954e6b992 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:31.423747 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fef5dbe9-4562-4882-a09b-e34954e6b992 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:31.424162 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fef5dbe9-4562-4882-a09b-e34954e6b992 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:31.424820 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fef5dbe9-4562-4882-a09b-e34954e6b992 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:31.425216 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fef5dbe9-4562-4882-a09b-e34954e6b992 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:31.519374 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-fef5dbe9-4562-4882-a09b-e34954e6b992 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:31.528145 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-fef5dbe9-4562-4882-a09b-e34954e6b992 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b" status: 200 len: 1279 microversion: 2.1 time: 0.118655 Oct 24 13:31:31.528936 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 359/717] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:31 2022] GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b => generated 1279 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:31:32.552219 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1ce712da-23d8-44da-aec0-bac48f675589 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:32.552814 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-1ce712da-23d8-44da-aec0-bac48f675589 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:32.559316 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1ce712da-23d8-44da-aec0-bac48f675589 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:32.559788 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1ce712da-23d8-44da-aec0-bac48f675589 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:32.560212 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1ce712da-23d8-44da-aec0-bac48f675589 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:32.560923 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1ce712da-23d8-44da-aec0-bac48f675589 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:32.561364 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1ce712da-23d8-44da-aec0-bac48f675589 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:32.561777 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1ce712da-23d8-44da-aec0-bac48f675589 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:32.692786 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1ce712da-23d8-44da-aec0-bac48f675589 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:32.703812 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1ce712da-23d8-44da-aec0-bac48f675589 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b" status: 200 len: 1319 microversion: 2.1 time: 0.153861 Oct 24 13:31:32.703812 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 359/718] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:32 2022] GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:31:33.006236 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-b56b824d-d891-4e37-a457-ae67c2f3139e req-1624d835-253a-4c62-9aad-133c42079210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a5500e-2b5e-4fad-b0d6-2a44310d907b", "tag": "143223ad-baec-4f7f-a08a-a4108c9f8dc0"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:31:33.017071 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-b56b824d-d891-4e37-a457-ae67c2f3139e req-1624d835-253a-4c62-9aad-133c42079210 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:33.017545 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-b56b824d-d891-4e37-a457-ae67c2f3139e req-1624d835-253a-4c62-9aad-133c42079210 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:33.017967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-b56b824d-d891-4e37-a457-ae67c2f3139e req-1624d835-253a-4c62-9aad-133c42079210 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:33.029430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-b56b824d-d891-4e37-a457-ae67c2f3139e req-1624d835-253a-4c62-9aad-133c42079210 service nova] Creating event network-changed:143223ad-baec-4f7f-a08a-a4108c9f8dc0 for instance b6a5500e-2b5e-4fad-b0d6-2a44310d907b on hv-cinder-86249 Oct 24 13:31:33.034351 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-b56b824d-d891-4e37-a457-ae67c2f3139e req-1624d835-253a-4c62-9aad-133c42079210 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031816 Oct 24 13:31:33.034951 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 360/719] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:31:33.725946 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-85ab58ad-11bc-412c-8875-00e6a08c9609 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:33.726549 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-85ab58ad-11bc-412c-8875-00e6a08c9609 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:33.733482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-85ab58ad-11bc-412c-8875-00e6a08c9609 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:33.733964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-85ab58ad-11bc-412c-8875-00e6a08c9609 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:33.734391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-85ab58ad-11bc-412c-8875-00e6a08c9609 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:33.735060 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-85ab58ad-11bc-412c-8875-00e6a08c9609 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:33.735505 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-85ab58ad-11bc-412c-8875-00e6a08c9609 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:33.735918 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-85ab58ad-11bc-412c-8875-00e6a08c9609 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:33.864393 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-85ab58ad-11bc-412c-8875-00e6a08c9609 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:33.872157 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-85ab58ad-11bc-412c-8875-00e6a08c9609 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b" status: 200 len: 1319 microversion: 2.1 time: 0.149972 Oct 24 13:31:33.872750 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 360/720] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:33 2022] GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:31:34.896795 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-1326061c-58f3-4123-9ce6-3c129707b6e6 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:34.897765 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-1326061c-58f3-4123-9ce6-3c129707b6e6 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:34.903606 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1326061c-58f3-4123-9ce6-3c129707b6e6 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:34.905349 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1326061c-58f3-4123-9ce6-3c129707b6e6 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:34.905349 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1326061c-58f3-4123-9ce6-3c129707b6e6 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:34.905349 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1326061c-58f3-4123-9ce6-3c129707b6e6 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:34.905633 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1326061c-58f3-4123-9ce6-3c129707b6e6 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:34.906034 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1326061c-58f3-4123-9ce6-3c129707b6e6 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:35.036109 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1326061c-58f3-4123-9ce6-3c129707b6e6 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:35.043731 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-1326061c-58f3-4123-9ce6-3c129707b6e6 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b" status: 200 len: 1319 microversion: 2.1 time: 0.151814 Oct 24 13:31:35.044317 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 361/721] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:34 2022] GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:31:36.066915 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9000620d-dadd-4727-bc6d-770eb0ddec04 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:36.067519 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-9000620d-dadd-4727-bc6d-770eb0ddec04 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:36.074331 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9000620d-dadd-4727-bc6d-770eb0ddec04 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:36.074801 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9000620d-dadd-4727-bc6d-770eb0ddec04 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:36.075229 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9000620d-dadd-4727-bc6d-770eb0ddec04 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:36.076153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9000620d-dadd-4727-bc6d-770eb0ddec04 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:36.076622 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9000620d-dadd-4727-bc6d-770eb0ddec04 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:36.077034 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9000620d-dadd-4727-bc6d-770eb0ddec04 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:36.202690 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-9000620d-dadd-4727-bc6d-770eb0ddec04 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:36.210124 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9000620d-dadd-4727-bc6d-770eb0ddec04 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b" status: 200 len: 1319 microversion: 2.1 time: 0.147097 Oct 24 13:31:36.210683 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 361/722] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:36 2022] GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:31:37.233743 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-161a80a6-ab96-41fc-9f6e-e621932f396c tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:37.234341 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-161a80a6-ab96-41fc-9f6e-e621932f396c tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:37.240620 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-161a80a6-ab96-41fc-9f6e-e621932f396c tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:37.241085 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-161a80a6-ab96-41fc-9f6e-e621932f396c tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:37.241502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-161a80a6-ab96-41fc-9f6e-e621932f396c tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:37.242170 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-161a80a6-ab96-41fc-9f6e-e621932f396c tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:37.242609 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-161a80a6-ab96-41fc-9f6e-e621932f396c tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:37.243020 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-161a80a6-ab96-41fc-9f6e-e621932f396c tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:37.374650 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-161a80a6-ab96-41fc-9f6e-e621932f396c tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:37.382415 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-161a80a6-ab96-41fc-9f6e-e621932f396c tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b" status: 200 len: 1319 microversion: 2.1 time: 0.153287 Oct 24 13:31:37.385243 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 362/723] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:37 2022] GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:31:38.405670 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e02d3b4b-a0f7-43e2-a82a-05331d6cb437 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:38.406291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e02d3b4b-a0f7-43e2-a82a-05331d6cb437 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:38.412815 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e02d3b4b-a0f7-43e2-a82a-05331d6cb437 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:38.413301 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e02d3b4b-a0f7-43e2-a82a-05331d6cb437 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:38.413737 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e02d3b4b-a0f7-43e2-a82a-05331d6cb437 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:38.414420 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e02d3b4b-a0f7-43e2-a82a-05331d6cb437 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:38.414871 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e02d3b4b-a0f7-43e2-a82a-05331d6cb437 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:38.415289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e02d3b4b-a0f7-43e2-a82a-05331d6cb437 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:38.543068 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e02d3b4b-a0f7-43e2-a82a-05331d6cb437 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:38.550929 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e02d3b4b-a0f7-43e2-a82a-05331d6cb437 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b" status: 200 len: 1319 microversion: 2.1 time: 0.149216 Oct 24 13:31:38.551502 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 362/724] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:38 2022] GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:31:39.285432 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=2 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:39.372987 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-b70f73cb-4c2c-4dd0-8a3f-329e6ea88f6f req-8382ece7-dcfd-4b01-bcd3-e6704d67cd8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a5500e-2b5e-4fad-b0d6-2a44310d907b", "name": "network-vif-plugged", "status": "completed", "tag": "143223ad-baec-4f7f-a08a-a4108c9f8dc0"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:31:39.382446 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-b70f73cb-4c2c-4dd0-8a3f-329e6ea88f6f req-8382ece7-dcfd-4b01-bcd3-e6704d67cd8c service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:39.382907 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-b70f73cb-4c2c-4dd0-8a3f-329e6ea88f6f req-8382ece7-dcfd-4b01-bcd3-e6704d67cd8c service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:39.383323 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-b70f73cb-4c2c-4dd0-8a3f-329e6ea88f6f req-8382ece7-dcfd-4b01-bcd3-e6704d67cd8c service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:39.394618 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-b70f73cb-4c2c-4dd0-8a3f-329e6ea88f6f req-8382ece7-dcfd-4b01-bcd3-e6704d67cd8c service nova] Creating event network-vif-plugged:143223ad-baec-4f7f-a08a-a4108c9f8dc0 for instance b6a5500e-2b5e-4fad-b0d6-2a44310d907b on hv-cinder-86249 Oct 24 13:31:39.399384 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-b70f73cb-4c2c-4dd0-8a3f-329e6ea88f6f req-8382ece7-dcfd-4b01-bcd3-e6704d67cd8c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150573 Oct 24 13:31:39.399950 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 363/725] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:31:39.575264 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-4e1af0c1-fcad-4086-8850-da2342edff44 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:39.576068 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-4e1af0c1-fcad-4086-8850-da2342edff44 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:39.577917 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=2 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:39.578582 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=6 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:31:39.583687 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4e1af0c1-fcad-4086-8850-da2342edff44 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:39.584160 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4e1af0c1-fcad-4086-8850-da2342edff44 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:39.584638 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4e1af0c1-fcad-4086-8850-da2342edff44 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:39.585309 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4e1af0c1-fcad-4086-8850-da2342edff44 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:39.585751 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4e1af0c1-fcad-4086-8850-da2342edff44 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:39.586163 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4e1af0c1-fcad-4086-8850-da2342edff44 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:39.717030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-4e1af0c1-fcad-4086-8850-da2342edff44 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:39.724805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-4e1af0c1-fcad-4086-8850-da2342edff44 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b" status: 200 len: 1319 microversion: 2.1 time: 0.154005 Oct 24 13:31:39.725374 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 363/726] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:39 2022] GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:31:40.749599 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ab246e2d-6c6e-4df3-be8e-b694382cd570 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:40.750289 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ab246e2d-6c6e-4df3-be8e-b694382cd570 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:40.756525 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ab246e2d-6c6e-4df3-be8e-b694382cd570 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:40.756952 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ab246e2d-6c6e-4df3-be8e-b694382cd570 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:40.757382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ab246e2d-6c6e-4df3-be8e-b694382cd570 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:40.758060 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ab246e2d-6c6e-4df3-be8e-b694382cd570 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:40.758502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ab246e2d-6c6e-4df3-be8e-b694382cd570 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:40.758915 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ab246e2d-6c6e-4df3-be8e-b694382cd570 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:40.886664 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ab246e2d-6c6e-4df3-be8e-b694382cd570 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:40.894297 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ab246e2d-6c6e-4df3-be8e-b694382cd570 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b" status: 200 len: 1319 microversion: 2.1 time: 0.149409 Oct 24 13:31:40.894853 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 364/727] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:40 2022] GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:31:41.917238 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7e570980-1858-451f-9495-8b082a8f1542 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:31:41.917805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7e570980-1858-451f-9495-8b082a8f1542 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:41.924176 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7e570980-1858-451f-9495-8b082a8f1542 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:41.924683 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7e570980-1858-451f-9495-8b082a8f1542 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:41.925113 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7e570980-1858-451f-9495-8b082a8f1542 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:41.925791 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7e570980-1858-451f-9495-8b082a8f1542 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:41.926242 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7e570980-1858-451f-9495-8b082a8f1542 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:41.926692 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7e570980-1858-451f-9495-8b082a8f1542 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:42.051062 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7e570980-1858-451f-9495-8b082a8f1542 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:31:42.059355 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7e570980-1858-451f-9495-8b082a8f1542 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b" status: 200 len: 1508 microversion: 2.1 time: 0.146125 Oct 24 13:31:42.059924 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 364/728] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:31:41 2022] GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:31:42.081944 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-eb43cdea-fa26-492f-b17d-d00e9d3271da tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1212363-97e2-4eb0-83f2-6d1b9b68e9de", "device": "/dev/sdb"}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:31:42.084834 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-eb43cdea-fa26-492f-b17d-d00e9d3271da tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:31:42.091259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-eb43cdea-fa26-492f-b17d-d00e9d3271da tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:42.091740 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-eb43cdea-fa26-492f-b17d-d00e9d3271da tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:42.092173 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-eb43cdea-fa26-492f-b17d-d00e9d3271da tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:42.092897 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-eb43cdea-fa26-492f-b17d-d00e9d3271da tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:31:42.093348 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-eb43cdea-fa26-492f-b17d-d00e9d3271da tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:31:42.093777 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-eb43cdea-fa26-492f-b17d-d00e9d3271da tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:31:42.804911 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-eb43cdea-fa26-492f-b17d-d00e9d3271da tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "POST /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.726635 Oct 24 13:31:42.805519 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 365/729] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 24 13:31:42 2022] POST /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b/os-volume_attachments => generated 194 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:32:06.092835 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:06.093542 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=57 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:06.195300 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-6bb28393-5b9b-4703-8869-f83caef385ca tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:06.195796 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-6bb28393-5b9b-4703-8869-f83caef385ca tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:06.202476 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6bb28393-5b9b-4703-8869-f83caef385ca tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:06.203214 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6bb28393-5b9b-4703-8869-f83caef385ca tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:06.203383 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6bb28393-5b9b-4703-8869-f83caef385ca tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:06.204075 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6bb28393-5b9b-4703-8869-f83caef385ca tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:06.204542 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6bb28393-5b9b-4703-8869-f83caef385ca tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:06.204964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6bb28393-5b9b-4703-8869-f83caef385ca tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:06.284087 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.objects.instance [None req-6bb28393-5b9b-4703-8869-f83caef385ca tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lazy-loading 'services' on Instance uuid a568b3c6-b364-45d0-a9fa-2bdbde43ccaa {{(pid=119146) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:32:06.496527 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-6bb28393-5b9b-4703-8869-f83caef385ca tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa/os-volume_attachments/8cd4e1f4-1ec6-4e62-af9f-8877eeb11054" status: 202 len: 0 microversion: 2.1 time: 0.409073 Oct 24 13:32:06.497125 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 365/730] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 24 13:32:06 2022] DELETE /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa/os-volume_attachments/8cd4e1f4-1ec6-4e62-af9f-8877eeb11054 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:32:06.865429 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=19 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:06.866218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:06.870428 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8e8d1a28-6e17-49e6-87d1-d5c6f046582e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:06.871008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-8e8d1a28-6e17-49e6-87d1-d5c6f046582e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:06.877186 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8e8d1a28-6e17-49e6-87d1-d5c6f046582e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:06.878873 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8e8d1a28-6e17-49e6-87d1-d5c6f046582e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:06.878873 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8e8d1a28-6e17-49e6-87d1-d5c6f046582e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:06.878873 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8e8d1a28-6e17-49e6-87d1-d5c6f046582e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:06.879341 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8e8d1a28-6e17-49e6-87d1-d5c6f046582e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:06.879762 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8e8d1a28-6e17-49e6-87d1-d5c6f046582e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:07.001704 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.objects.instance [None req-8e8d1a28-6e17-49e6-87d1-d5c6f046582e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lazy-loading 'services' on Instance uuid b6a5500e-2b5e-4fad-b0d6-2a44310d907b {{(pid=119145) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:32:07.275884 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-8e8d1a28-6e17-49e6-87d1-d5c6f046582e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b/os-volume_attachments/b1212363-97e2-4eb0-83f2-6d1b9b68e9de" status: 202 len: 0 microversion: 2.1 time: 0.411617 Oct 24 13:32:07.276769 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 366/731] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 24 13:32:06 2022] DELETE /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b/os-volume_attachments/b1212363-97e2-4eb0-83f2-6d1b9b68e9de => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:32:08.679530 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-cb8de208-7685-494d-8471-7e53c2b0f657 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:32:08.686782 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb8de208-7685-494d-8471-7e53c2b0f657 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:08.686782 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb8de208-7685-494d-8471-7e53c2b0f657 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:08.686782 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb8de208-7685-494d-8471-7e53c2b0f657 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:08.746541 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-cb8de208-7685-494d-8471-7e53c2b0f657 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Going to try to stop instance {{(pid=119146) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 13:32:08.969673 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-cb8de208-7685-494d-8471-7e53c2b0f657 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "POST /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa/action" status: 202 len: 0 microversion: 2.1 time: 0.294679 Oct 24 13:32:08.970309 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 366/732] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 24 13:32:08 2022] POST /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:32:08.979128 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ba806ccd-1480-40ad-b849-171254f8dbe6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:08.979829 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ba806ccd-1480-40ad-b849-171254f8dbe6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:08.986677 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba806ccd-1480-40ad-b849-171254f8dbe6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:08.987157 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba806ccd-1480-40ad-b849-171254f8dbe6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:08.987584 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba806ccd-1480-40ad-b849-171254f8dbe6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:08.988298 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba806ccd-1480-40ad-b849-171254f8dbe6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:08.988756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba806ccd-1480-40ad-b849-171254f8dbe6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:08.989179 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba806ccd-1480-40ad-b849-171254f8dbe6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:09.117994 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ba806ccd-1480-40ad-b849-171254f8dbe6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:09.125690 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ba806ccd-1480-40ad-b849-171254f8dbe6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1678 microversion: 2.1 time: 0.150846 Oct 24 13:32:09.126256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 367/733] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:08 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:09.457234 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-2310fd33-8820-44f6-af95-3cb06829c90e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:09.457926 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-2310fd33-8820-44f6-af95-3cb06829c90e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:09.463928 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2310fd33-8820-44f6-af95-3cb06829c90e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:09.464446 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2310fd33-8820-44f6-af95-3cb06829c90e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:09.464931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2310fd33-8820-44f6-af95-3cb06829c90e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:09.465611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2310fd33-8820-44f6-af95-3cb06829c90e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:09.466054 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2310fd33-8820-44f6-af95-3cb06829c90e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:09.466470 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2310fd33-8820-44f6-af95-3cb06829c90e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:09.492342 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-2310fd33-8820-44f6-af95-3cb06829c90e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Going to try to terminate instance {{(pid=119146) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:32:09.760993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-2310fd33-8820-44f6-af95-3cb06829c90e tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b" status: 204 len: 0 microversion: 2.1 time: 0.307489 Oct 24 13:32:09.761638 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 367/734] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:32:09 2022] DELETE /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:32:09.769640 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-da3b525b-5531-41b3-841d-a5e34136fe2a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:09.770684 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-da3b525b-5531-41b3-841d-a5e34136fe2a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:09.776789 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-da3b525b-5531-41b3-841d-a5e34136fe2a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:09.777262 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-da3b525b-5531-41b3-841d-a5e34136fe2a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:09.777720 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-da3b525b-5531-41b3-841d-a5e34136fe2a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:09.778401 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-da3b525b-5531-41b3-841d-a5e34136fe2a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:09.778852 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-da3b525b-5531-41b3-841d-a5e34136fe2a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:09.779269 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-da3b525b-5531-41b3-841d-a5e34136fe2a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:09.908647 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-da3b525b-5531-41b3-841d-a5e34136fe2a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:09.916331 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-da3b525b-5531-41b3-841d-a5e34136fe2a tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b" status: 200 len: 1514 microversion: 2.1 time: 0.150521 Oct 24 13:32:09.916902 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 368/735] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:09 2022] GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:10.151954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b2000cc6-ff1f-4901-b552-3b2de2e8751f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:10.152697 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b2000cc6-ff1f-4901-b552-3b2de2e8751f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:10.158556 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2000cc6-ff1f-4901-b552-3b2de2e8751f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:10.159033 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2000cc6-ff1f-4901-b552-3b2de2e8751f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:10.159464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2000cc6-ff1f-4901-b552-3b2de2e8751f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:10.160142 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2000cc6-ff1f-4901-b552-3b2de2e8751f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:10.160624 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2000cc6-ff1f-4901-b552-3b2de2e8751f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:10.161042 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b2000cc6-ff1f-4901-b552-3b2de2e8751f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:10.290802 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b2000cc6-ff1f-4901-b552-3b2de2e8751f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:10.298720 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b2000cc6-ff1f-4901-b552-3b2de2e8751f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1678 microversion: 2.1 time: 0.151000 Oct 24 13:32:10.299293 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 368/736] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:10 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:10.938575 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-51a398b4-7daa-41f8-9d0d-875ce0f6ab38 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:10.939177 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-51a398b4-7daa-41f8-9d0d-875ce0f6ab38 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:10.945503 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-51a398b4-7daa-41f8-9d0d-875ce0f6ab38 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:10.945971 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-51a398b4-7daa-41f8-9d0d-875ce0f6ab38 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:10.946394 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-51a398b4-7daa-41f8-9d0d-875ce0f6ab38 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:10.947061 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-51a398b4-7daa-41f8-9d0d-875ce0f6ab38 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:10.947504 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-51a398b4-7daa-41f8-9d0d-875ce0f6ab38 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:10.947913 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-51a398b4-7daa-41f8-9d0d-875ce0f6ab38 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:11.072950 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-51a398b4-7daa-41f8-9d0d-875ce0f6ab38 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:11.080967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-51a398b4-7daa-41f8-9d0d-875ce0f6ab38 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b" status: 200 len: 1514 microversion: 2.1 time: 0.146212 Oct 24 13:32:11.081530 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 369/737] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:10 2022] GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:11.322321 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5dfdaf16-3dc1-4701-a043-366cf1e4ecd9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:11.322851 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5dfdaf16-3dc1-4701-a043-366cf1e4ecd9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:11.330285 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5dfdaf16-3dc1-4701-a043-366cf1e4ecd9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:11.330761 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5dfdaf16-3dc1-4701-a043-366cf1e4ecd9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:11.331190 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5dfdaf16-3dc1-4701-a043-366cf1e4ecd9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:11.331871 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5dfdaf16-3dc1-4701-a043-366cf1e4ecd9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:11.332344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5dfdaf16-3dc1-4701-a043-366cf1e4ecd9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:11.332763 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5dfdaf16-3dc1-4701-a043-366cf1e4ecd9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:11.456258 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5dfdaf16-3dc1-4701-a043-366cf1e4ecd9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:11.463885 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5dfdaf16-3dc1-4701-a043-366cf1e4ecd9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1678 microversion: 2.1 time: 0.145553 Oct 24 13:32:11.464471 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 369/738] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:11 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:12.104747 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b206a8a4-3f0c-4287-96b8-4d1bd6146747 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:12.111748 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b206a8a4-3f0c-4287-96b8-4d1bd6146747 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:12.112235 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b206a8a4-3f0c-4287-96b8-4d1bd6146747 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:12.112745 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b206a8a4-3f0c-4287-96b8-4d1bd6146747 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:12.113176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b206a8a4-3f0c-4287-96b8-4d1bd6146747 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:12.113852 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b206a8a4-3f0c-4287-96b8-4d1bd6146747 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:12.114301 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b206a8a4-3f0c-4287-96b8-4d1bd6146747 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:12.114716 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b206a8a4-3f0c-4287-96b8-4d1bd6146747 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:12.342837 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b206a8a4-3f0c-4287-96b8-4d1bd6146747 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:12.350760 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b206a8a4-3f0c-4287-96b8-4d1bd6146747 tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b" status: 200 len: 1514 microversion: 2.1 time: 0.249862 Oct 24 13:32:12.351270 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 370/739] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:12 2022] GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b => generated 1514 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:12.487576 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-d87bb40d-1942-4a67-af39-62a0ab5861fc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:12.488192 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-d87bb40d-1942-4a67-af39-62a0ab5861fc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:12.494606 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d87bb40d-1942-4a67-af39-62a0ab5861fc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:12.495089 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d87bb40d-1942-4a67-af39-62a0ab5861fc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:12.495521 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d87bb40d-1942-4a67-af39-62a0ab5861fc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:12.496210 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d87bb40d-1942-4a67-af39-62a0ab5861fc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:12.496696 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d87bb40d-1942-4a67-af39-62a0ab5861fc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:12.497120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d87bb40d-1942-4a67-af39-62a0ab5861fc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:12.630599 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-d87bb40d-1942-4a67-af39-62a0ab5861fc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:12.638428 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-d87bb40d-1942-4a67-af39-62a0ab5861fc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1678 microversion: 2.1 time: 0.154732 Oct 24 13:32:12.639051 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 370/740] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:12 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:12.702215 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-667e91c7-5b31-44f9-be15-f890f510e755 req-df9843a2-7269-48b2-9cd5-1a22cf0f0050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a5500e-2b5e-4fad-b0d6-2a44310d907b", "name": "network-vif-deleted", "tag": "143223ad-baec-4f7f-a08a-a4108c9f8dc0"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:32:12.711588 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-667e91c7-5b31-44f9-be15-f890f510e755 req-df9843a2-7269-48b2-9cd5-1a22cf0f0050 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:12.712052 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-667e91c7-5b31-44f9-be15-f890f510e755 req-df9843a2-7269-48b2-9cd5-1a22cf0f0050 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:12.712568 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-667e91c7-5b31-44f9-be15-f890f510e755 req-df9843a2-7269-48b2-9cd5-1a22cf0f0050 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:12.725943 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-667e91c7-5b31-44f9-be15-f890f510e755 req-df9843a2-7269-48b2-9cd5-1a22cf0f0050 service nova] Creating event network-vif-deleted:143223ad-baec-4f7f-a08a-a4108c9f8dc0 for instance b6a5500e-2b5e-4fad-b0d6-2a44310d907b on hv-cinder-86249 Oct 24 13:32:12.731209 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-667e91c7-5b31-44f9-be15-f890f510e755 req-df9843a2-7269-48b2-9cd5-1a22cf0f0050 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033517 Oct 24 13:32:12.737284 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 371/741] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:32:13.374917 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c64d4fda-6f7f-4b5d-a471-24cbe6805bdd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:13.375449 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c64d4fda-6f7f-4b5d-a471-24cbe6805bdd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:13.381264 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c64d4fda-6f7f-4b5d-a471-24cbe6805bdd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:13.381732 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c64d4fda-6f7f-4b5d-a471-24cbe6805bdd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:13.382154 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c64d4fda-6f7f-4b5d-a471-24cbe6805bdd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:13.382830 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c64d4fda-6f7f-4b5d-a471-24cbe6805bdd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:13.383275 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c64d4fda-6f7f-4b5d-a471-24cbe6805bdd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:13.383707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c64d4fda-6f7f-4b5d-a471-24cbe6805bdd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:13.413337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c64d4fda-6f7f-4b5d-a471-24cbe6805bdd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:13.413804 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c64d4fda-6f7f-4b5d-a471-24cbe6805bdd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:13.414223 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c64d4fda-6f7f-4b5d-a471-24cbe6805bdd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:13.414656 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.objects.instance [None req-c64d4fda-6f7f-4b5d-a471-24cbe6805bdd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lazy-loading 'fault' on Instance uuid b6a5500e-2b5e-4fad-b0d6-2a44310d907b {{(pid=119146) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:32:13.457191 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c64d4fda-6f7f-4b5d-a471-24cbe6805bdd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315f9ad503b8402090faac7b827b5463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3097281d4c43458b408414648233a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:13.464659 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c64d4fda-6f7f-4b5d-a471-24cbe6805bdd tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b" status: 200 len: 1309 microversion: 2.1 time: 0.094042 Oct 24 13:32:13.465227 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 371/742] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:13 2022] GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:13.663150 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0eda49c8-81e3-4e2c-b14a-c34876bec827 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:13.666882 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0eda49c8-81e3-4e2c-b14a-c34876bec827 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:13.670555 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0eda49c8-81e3-4e2c-b14a-c34876bec827 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:13.671024 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0eda49c8-81e3-4e2c-b14a-c34876bec827 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:13.671450 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0eda49c8-81e3-4e2c-b14a-c34876bec827 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:13.672118 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0eda49c8-81e3-4e2c-b14a-c34876bec827 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:13.672634 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0eda49c8-81e3-4e2c-b14a-c34876bec827 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:13.673065 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0eda49c8-81e3-4e2c-b14a-c34876bec827 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:13.806651 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0eda49c8-81e3-4e2c-b14a-c34876bec827 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:13.814884 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0eda49c8-81e3-4e2c-b14a-c34876bec827 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1678 microversion: 2.1 time: 0.156375 Oct 24 13:32:13.815446 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 372/743] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:13 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:14.486897 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-d1935682-c1ef-4faf-b641-db01ccb6517b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:14.487514 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-d1935682-c1ef-4faf-b641-db01ccb6517b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] [instance: b6a5500e-2b5e-4fad-b0d6-2a44310d907b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:14.493980 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d1935682-c1ef-4faf-b641-db01ccb6517b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:14.494455 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d1935682-c1ef-4faf-b641-db01ccb6517b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:14.494884 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d1935682-c1ef-4faf-b641-db01ccb6517b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:14.495563 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d1935682-c1ef-4faf-b641-db01ccb6517b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:14.496018 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d1935682-c1ef-4faf-b641-db01ccb6517b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:14.496467 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d1935682-c1ef-4faf-b641-db01ccb6517b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:14.509407 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-d1935682-c1ef-4faf-b641-db01ccb6517b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] HTTP exception thrown: Instance b6a5500e-2b5e-4fad-b0d6-2a44310d907b could not be found. Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-d1935682-c1ef-4faf-b641-db01ccb6517b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Request method failure captured: Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b HTTP/1.1 Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpMgFEr-fCUWzoASLJGX21zHASG1ljWv1VWajLzZ6JWsqVFAUqNvpryKHLsXO0WdvnG9_YYXNT_J9iCGLMewjRMzA_8ojfDeSv_iyA_rw5LBt_-QqbSZWQc37Ohr8rFskYtmrvtTVofUhmvxS7wfA_nqA_ddMkklrpQWLtMBYEdqYgM Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: ca3097281d4c43458b408414648233a0 Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-VolumesSnapshotTestJSON-428204675 Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:32:14.511008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:32:14.513191 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca3097281d4c43458b408414648233a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca3097281d4c43458b408414648233a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca3097281d4c43458b408414648233a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca3097281d4c43458b408414648233a0"}]}] Oct 24 13:32:14.513191 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-VolumesSnapshotTestJSON-428204675 Oct 24 13:32:14.513191 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: ca3097281d4c43458b408414648233a0 Oct 24 13:32:14.513191 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-428204675 Oct 24 13:32:14.513191 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-VolumesSnapshotTestJSON-428204675-project Oct 24 13:32:14.513191 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:32:14.513191 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:32:14.513191 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 315f9ad503b8402090faac7b827b5463 Oct 24 13:32:14.513191 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-VolumesSnapshotTestJSON-428204675-project Oct 24 13:32:14.513191 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:32:14.513191 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Instance b6a5500e-2b5e-4fad-b0d6-2a44310d907b could not be found. Oct 24 13:32:14.513191 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': 'b6a5500e-2b5e-4fad-b0d6-2a44310d907b'} Oct 24 13:32:14.514167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:32:14.514167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:32:14.514167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:32:14.514167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:32:14.514167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:32:14.514167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:32:14.514167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:32:14.514167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:32:14.514167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:32:14.514167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:32:14.514167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a5500e-2b5e-4fad-b0d6-2a44310d907b could not be found. Oct 24 13:32:14.514167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:32:14.514167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:32:14.514167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:32:14.514167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:32:14.514167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:32:14.514167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:32:14.514167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:32:14.514167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:32:14.514167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:32:14.515881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:32:14.515881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:32:14.515881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:32:14.515881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:32:14.515881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:32:14.515881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:32:14.515881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:32:14.515881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a5500e-2b5e-4fad-b0d6-2a44310d907b could not be found. Oct 24 13:32:14.515881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:32:14.515881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:32:14.515881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:32:14.515881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:32:14.515881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:32:14.515881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:32:14.515881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:32:14.515881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:32:14.515881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a5500e-2b5e-4fad-b0d6-2a44310d907b could not be found. Oct 24 13:32:14.515881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:32:14.517266 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-d1935682-c1ef-4faf-b641-db01ccb6517b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] Returning 404 to user: Instance b6a5500e-2b5e-4fad-b0d6-2a44310d907b could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:32:14.517266 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-d1935682-c1ef-4faf-b641-db01ccb6517b tempest-VolumesSnapshotTestJSON-428204675 tempest-VolumesSnapshotTestJSON-428204675-project] 10.222.0.48 "GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b" status: 404 len: 111 microversion: 2.1 time: 0.029863 Oct 24 13:32:14.517266 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 372/744] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:14 2022] GET /compute/v2.1/servers/b6a5500e-2b5e-4fad-b0d6-2a44310d907b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:32:14.837944 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a10588dc-c9ee-4acb-9cc9-ac57630ca510 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:14.838570 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a10588dc-c9ee-4acb-9cc9-ac57630ca510 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:14.845181 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a10588dc-c9ee-4acb-9cc9-ac57630ca510 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:14.845648 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a10588dc-c9ee-4acb-9cc9-ac57630ca510 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:14.846068 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a10588dc-c9ee-4acb-9cc9-ac57630ca510 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:14.846768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a10588dc-c9ee-4acb-9cc9-ac57630ca510 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:14.847168 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a10588dc-c9ee-4acb-9cc9-ac57630ca510 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:14.847573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a10588dc-c9ee-4acb-9cc9-ac57630ca510 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:14.991334 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a10588dc-c9ee-4acb-9cc9-ac57630ca510 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:15.000356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a10588dc-c9ee-4acb-9cc9-ac57630ca510 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1678 microversion: 2.1 time: 0.166346 Oct 24 13:32:15.000928 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 373/745] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:14 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:16.023251 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7d2e442e-9c48-4f2f-8d7b-7411bb8dcce1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:16.023958 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7d2e442e-9c48-4f2f-8d7b-7411bb8dcce1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:16.032337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7d2e442e-9c48-4f2f-8d7b-7411bb8dcce1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:16.032934 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7d2e442e-9c48-4f2f-8d7b-7411bb8dcce1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:16.033421 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7d2e442e-9c48-4f2f-8d7b-7411bb8dcce1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:16.034156 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7d2e442e-9c48-4f2f-8d7b-7411bb8dcce1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:16.034602 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7d2e442e-9c48-4f2f-8d7b-7411bb8dcce1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:16.035015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7d2e442e-9c48-4f2f-8d7b-7411bb8dcce1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:16.170416 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7d2e442e-9c48-4f2f-8d7b-7411bb8dcce1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:16.178310 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7d2e442e-9c48-4f2f-8d7b-7411bb8dcce1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1678 microversion: 2.1 time: 0.159168 Oct 24 13:32:16.188836 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 373/746] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:16 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:16.471175 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-eba0ccd0-00e9-4415-b349-f731be84dabf tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:32:16.473357 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-eba0ccd0-00e9-4415-b349-f731be84dabf tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:16.479809 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-eba0ccd0-00e9-4415-b349-f731be84dabf tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:16.484006 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-eba0ccd0-00e9-4415-b349-f731be84dabf tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:16.484006 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-eba0ccd0-00e9-4415-b349-f731be84dabf tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:16.484006 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-eba0ccd0-00e9-4415-b349-f731be84dabf tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:16.484006 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-eba0ccd0-00e9-4415-b349-f731be84dabf tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:16.484548 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-eba0ccd0-00e9-4415-b349-f731be84dabf tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:16.673506 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-eba0ccd0-00e9-4415-b349-f731be84dabf tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "POST /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac/action" status: 202 len: 0 microversion: 2.1 time: 0.205937 Oct 24 13:32:16.674523 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 374/747] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 24 13:32:16 2022] POST /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:32:16.682608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e11557e5-793e-4b08-b747-3beb2856cff2 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:16.683213 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e11557e5-793e-4b08-b747-3beb2856cff2 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:16.689665 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e11557e5-793e-4b08-b747-3beb2856cff2 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:16.690135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e11557e5-793e-4b08-b747-3beb2856cff2 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:16.690558 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e11557e5-793e-4b08-b747-3beb2856cff2 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:16.691236 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e11557e5-793e-4b08-b747-3beb2856cff2 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:16.691676 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e11557e5-793e-4b08-b747-3beb2856cff2 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:16.692089 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e11557e5-793e-4b08-b747-3beb2856cff2 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:16.839073 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e11557e5-793e-4b08-b747-3beb2856cff2 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:16.847659 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e11557e5-793e-4b08-b747-3beb2856cff2 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1751 microversion: 2.1 time: 0.168942 Oct 24 13:32:16.848296 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 374/748] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:16 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:17.203205 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-fb0ae7a3-c4f0-4bab-90cf-5f8c0dbca501 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:17.203898 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-fb0ae7a3-c4f0-4bab-90cf-5f8c0dbca501 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:17.210168 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb0ae7a3-c4f0-4bab-90cf-5f8c0dbca501 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:17.210638 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb0ae7a3-c4f0-4bab-90cf-5f8c0dbca501 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:17.211064 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb0ae7a3-c4f0-4bab-90cf-5f8c0dbca501 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:17.211738 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb0ae7a3-c4f0-4bab-90cf-5f8c0dbca501 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:17.212182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb0ae7a3-c4f0-4bab-90cf-5f8c0dbca501 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:17.212624 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb0ae7a3-c4f0-4bab-90cf-5f8c0dbca501 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:17.336833 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-fb0ae7a3-c4f0-4bab-90cf-5f8c0dbca501 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:17.345202 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-fb0ae7a3-c4f0-4bab-90cf-5f8c0dbca501 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1678 microversion: 2.1 time: 0.146929 Oct 24 13:32:17.345704 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 375/749] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:17 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:17.870834 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b5848f23-ef4d-41e8-ab01-2bab47917726 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:17.871445 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b5848f23-ef4d-41e8-ab01-2bab47917726 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:17.877896 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b5848f23-ef4d-41e8-ab01-2bab47917726 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:17.878368 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b5848f23-ef4d-41e8-ab01-2bab47917726 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:17.878793 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b5848f23-ef4d-41e8-ab01-2bab47917726 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:17.879465 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b5848f23-ef4d-41e8-ab01-2bab47917726 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:17.879907 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b5848f23-ef4d-41e8-ab01-2bab47917726 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:17.880338 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b5848f23-ef4d-41e8-ab01-2bab47917726 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:18.016243 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b5848f23-ef4d-41e8-ab01-2bab47917726 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:18.024254 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b5848f23-ef4d-41e8-ab01-2bab47917726 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1751 microversion: 2.1 time: 0.157255 Oct 24 13:32:18.024828 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 375/750] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:17 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:18.368154 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-70a944b7-049d-4dd5-8fad-c54de26cb572 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:18.368794 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-70a944b7-049d-4dd5-8fad-c54de26cb572 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:18.375624 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-70a944b7-049d-4dd5-8fad-c54de26cb572 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:18.376104 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-70a944b7-049d-4dd5-8fad-c54de26cb572 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:18.376567 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-70a944b7-049d-4dd5-8fad-c54de26cb572 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:18.377242 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-70a944b7-049d-4dd5-8fad-c54de26cb572 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:18.377689 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-70a944b7-049d-4dd5-8fad-c54de26cb572 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:18.378110 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-70a944b7-049d-4dd5-8fad-c54de26cb572 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:18.502134 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-70a944b7-049d-4dd5-8fad-c54de26cb572 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:18.509721 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-70a944b7-049d-4dd5-8fad-c54de26cb572 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1678 microversion: 2.1 time: 0.145421 Oct 24 13:32:18.510282 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 376/751] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:18 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:19.048246 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1e5e4aaa-4824-45d6-8891-3f44496872c1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:19.048926 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-1e5e4aaa-4824-45d6-8891-3f44496872c1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:19.055298 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1e5e4aaa-4824-45d6-8891-3f44496872c1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:19.057274 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1e5e4aaa-4824-45d6-8891-3f44496872c1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:19.057274 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1e5e4aaa-4824-45d6-8891-3f44496872c1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:19.057274 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1e5e4aaa-4824-45d6-8891-3f44496872c1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:19.057584 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1e5e4aaa-4824-45d6-8891-3f44496872c1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:19.057750 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1e5e4aaa-4824-45d6-8891-3f44496872c1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:19.200399 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1e5e4aaa-4824-45d6-8891-3f44496872c1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:19.208859 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1e5e4aaa-4824-45d6-8891-3f44496872c1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1751 microversion: 2.1 time: 0.164545 Oct 24 13:32:19.209424 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 376/752] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:19 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:19.533573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-213900c2-e3b1-441c-aed3-7d12bf052855 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:19.534202 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-213900c2-e3b1-441c-aed3-7d12bf052855 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:19.541009 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-213900c2-e3b1-441c-aed3-7d12bf052855 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:19.541477 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-213900c2-e3b1-441c-aed3-7d12bf052855 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:19.541911 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-213900c2-e3b1-441c-aed3-7d12bf052855 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:19.542566 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-213900c2-e3b1-441c-aed3-7d12bf052855 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:19.543004 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-213900c2-e3b1-441c-aed3-7d12bf052855 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:19.543414 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-213900c2-e3b1-441c-aed3-7d12bf052855 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:19.668952 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-213900c2-e3b1-441c-aed3-7d12bf052855 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:19.676549 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-213900c2-e3b1-441c-aed3-7d12bf052855 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1678 microversion: 2.1 time: 0.146734 Oct 24 13:32:19.677115 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 377/753] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:19 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:20.232823 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ec460521-5305-4200-8353-73a1987099d7 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:20.233426 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-ec460521-5305-4200-8353-73a1987099d7 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:20.239808 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ec460521-5305-4200-8353-73a1987099d7 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:20.240296 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ec460521-5305-4200-8353-73a1987099d7 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:20.240737 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ec460521-5305-4200-8353-73a1987099d7 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:20.241413 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ec460521-5305-4200-8353-73a1987099d7 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:20.241861 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ec460521-5305-4200-8353-73a1987099d7 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:20.242275 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ec460521-5305-4200-8353-73a1987099d7 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:20.384125 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ec460521-5305-4200-8353-73a1987099d7 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:20.392872 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-ec460521-5305-4200-8353-73a1987099d7 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1751 microversion: 2.1 time: 0.163956 Oct 24 13:32:20.393440 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 377/754] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:20 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:20.699780 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9d63bbe1-660f-477e-ae41-ec2af18b5633 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:20.700403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9d63bbe1-660f-477e-ae41-ec2af18b5633 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:20.707036 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9d63bbe1-660f-477e-ae41-ec2af18b5633 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:20.707509 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9d63bbe1-660f-477e-ae41-ec2af18b5633 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:20.707944 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9d63bbe1-660f-477e-ae41-ec2af18b5633 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:20.708634 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9d63bbe1-660f-477e-ae41-ec2af18b5633 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:20.709078 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9d63bbe1-660f-477e-ae41-ec2af18b5633 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:20.715952 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9d63bbe1-660f-477e-ae41-ec2af18b5633 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:20.841283 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9d63bbe1-660f-477e-ae41-ec2af18b5633 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:20.849122 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9d63bbe1-660f-477e-ae41-ec2af18b5633 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1678 microversion: 2.1 time: 0.153804 Oct 24 13:32:20.849688 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 378/755] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:20 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:21.416711 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1c5e8b47-7052-46c9-8162-81310d2f38b9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:21.417317 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-1c5e8b47-7052-46c9-8162-81310d2f38b9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:21.424258 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c5e8b47-7052-46c9-8162-81310d2f38b9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:21.424774 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c5e8b47-7052-46c9-8162-81310d2f38b9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:21.425203 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c5e8b47-7052-46c9-8162-81310d2f38b9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:21.425883 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c5e8b47-7052-46c9-8162-81310d2f38b9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:21.426333 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c5e8b47-7052-46c9-8162-81310d2f38b9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:21.426751 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c5e8b47-7052-46c9-8162-81310d2f38b9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:21.444878 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:21.567054 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1c5e8b47-7052-46c9-8162-81310d2f38b9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:21.575972 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1c5e8b47-7052-46c9-8162-81310d2f38b9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1756 microversion: 2.1 time: 0.162858 Oct 24 13:32:21.576599 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 378/756] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:21 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:21.872963 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-3801900e-ba41-4f7e-ad3f-e3ee062fa371 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:21.873562 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-3801900e-ba41-4f7e-ad3f-e3ee062fa371 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:21.879544 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3801900e-ba41-4f7e-ad3f-e3ee062fa371 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:21.880017 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3801900e-ba41-4f7e-ad3f-e3ee062fa371 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:21.880489 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3801900e-ba41-4f7e-ad3f-e3ee062fa371 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:21.881159 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3801900e-ba41-4f7e-ad3f-e3ee062fa371 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:21.881600 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3801900e-ba41-4f7e-ad3f-e3ee062fa371 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:21.882011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3801900e-ba41-4f7e-ad3f-e3ee062fa371 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:22.011500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-3801900e-ba41-4f7e-ad3f-e3ee062fa371 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:22.019420 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-3801900e-ba41-4f7e-ad3f-e3ee062fa371 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1678 microversion: 2.1 time: 0.150774 Oct 24 13:32:22.019999 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 379/757] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:21 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:22.599029 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8b3286ad-51ed-4315-ac30-1525283b87f9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:22.599641 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8b3286ad-51ed-4315-ac30-1525283b87f9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:22.608364 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8b3286ad-51ed-4315-ac30-1525283b87f9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:22.608859 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8b3286ad-51ed-4315-ac30-1525283b87f9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:22.609293 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8b3286ad-51ed-4315-ac30-1525283b87f9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:22.609986 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8b3286ad-51ed-4315-ac30-1525283b87f9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:22.610443 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8b3286ad-51ed-4315-ac30-1525283b87f9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:22.610861 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8b3286ad-51ed-4315-ac30-1525283b87f9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:22.755162 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8b3286ad-51ed-4315-ac30-1525283b87f9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:22.765457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8b3286ad-51ed-4315-ac30-1525283b87f9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1756 microversion: 2.1 time: 0.170304 Oct 24 13:32:22.769532 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 379/758] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:22 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:23.042734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-dca73eea-75ab-4639-8b40-1960cb6bd2e6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:23.043337 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-dca73eea-75ab-4639-8b40-1960cb6bd2e6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:23.049480 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dca73eea-75ab-4639-8b40-1960cb6bd2e6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:23.050000 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dca73eea-75ab-4639-8b40-1960cb6bd2e6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:23.050371 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dca73eea-75ab-4639-8b40-1960cb6bd2e6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:23.051054 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dca73eea-75ab-4639-8b40-1960cb6bd2e6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:23.051501 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dca73eea-75ab-4639-8b40-1960cb6bd2e6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:23.051913 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dca73eea-75ab-4639-8b40-1960cb6bd2e6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:23.181297 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-dca73eea-75ab-4639-8b40-1960cb6bd2e6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:23.190148 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-dca73eea-75ab-4639-8b40-1960cb6bd2e6 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1678 microversion: 2.1 time: 0.151742 Oct 24 13:32:23.190723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 380/759] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:23 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:23.789541 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-be625c60-56fa-4127-997a-0c82ae7ffb05 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:23.790142 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-be625c60-56fa-4127-997a-0c82ae7ffb05 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:23.796534 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-be625c60-56fa-4127-997a-0c82ae7ffb05 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:23.797007 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-be625c60-56fa-4127-997a-0c82ae7ffb05 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:23.797434 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-be625c60-56fa-4127-997a-0c82ae7ffb05 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:23.798108 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-be625c60-56fa-4127-997a-0c82ae7ffb05 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:23.798559 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-be625c60-56fa-4127-997a-0c82ae7ffb05 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:23.798974 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-be625c60-56fa-4127-997a-0c82ae7ffb05 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:23.937098 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-be625c60-56fa-4127-997a-0c82ae7ffb05 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:23.945262 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-be625c60-56fa-4127-997a-0c82ae7ffb05 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1756 microversion: 2.1 time: 0.159685 Oct 24 13:32:23.945830 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 380/760] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:23 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:24.213484 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6c0b28eb-b5f9-4adb-898d-cc01865e616a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:24.214010 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-6c0b28eb-b5f9-4adb-898d-cc01865e616a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:24.221077 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6c0b28eb-b5f9-4adb-898d-cc01865e616a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:24.221553 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6c0b28eb-b5f9-4adb-898d-cc01865e616a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:24.221982 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6c0b28eb-b5f9-4adb-898d-cc01865e616a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:24.222664 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6c0b28eb-b5f9-4adb-898d-cc01865e616a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:24.223110 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6c0b28eb-b5f9-4adb-898d-cc01865e616a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:24.223527 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6c0b28eb-b5f9-4adb-898d-cc01865e616a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:24.242061 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:24.351496 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-6c0b28eb-b5f9-4adb-898d-cc01865e616a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:24.359133 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6c0b28eb-b5f9-4adb-898d-cc01865e616a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1678 microversion: 2.1 time: 0.149626 Oct 24 13:32:24.359702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 381/761] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:24 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:24.969820 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-fc333192-fe47-4fa4-ab10-66b69c0b50a5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:24.970457 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-fc333192-fe47-4fa4-ab10-66b69c0b50a5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:24.976897 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fc333192-fe47-4fa4-ab10-66b69c0b50a5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:24.977377 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fc333192-fe47-4fa4-ab10-66b69c0b50a5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:24.977798 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fc333192-fe47-4fa4-ab10-66b69c0b50a5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:24.978599 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fc333192-fe47-4fa4-ab10-66b69c0b50a5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:24.979002 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fc333192-fe47-4fa4-ab10-66b69c0b50a5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:24.979341 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fc333192-fe47-4fa4-ab10-66b69c0b50a5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:25.028863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a1cffe84-a4d4-4a15-9fcf-5d921ad2c8a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b38a74e-70d4-4d07-a5f5-6b75e3238bbe"}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:32:25.031259 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a1cffe84-a4d4-4a15-9fcf-5d921ad2c8a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:25.039576 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a1cffe84-a4d4-4a15-9fcf-5d921ad2c8a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:25.040777 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a1cffe84-a4d4-4a15-9fcf-5d921ad2c8a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:25.040777 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a1cffe84-a4d4-4a15-9fcf-5d921ad2c8a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:25.041257 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a1cffe84-a4d4-4a15-9fcf-5d921ad2c8a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:25.041764 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a1cffe84-a4d4-4a15-9fcf-5d921ad2c8a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:25.042189 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a1cffe84-a4d4-4a15-9fcf-5d921ad2c8a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:25.129897 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-fc333192-fe47-4fa4-ab10-66b69c0b50a5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:25.138097 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-fc333192-fe47-4fa4-ab10-66b69c0b50a5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1756 microversion: 2.1 time: 0.172118 Oct 24 13:32:25.138660 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 382/762] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:24 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:25.382993 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-405fb2d0-0e00-40f5-a25f-d16f56ed8d4d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:25.383644 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-405fb2d0-0e00-40f5-a25f-d16f56ed8d4d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:25.390449 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-405fb2d0-0e00-40f5-a25f-d16f56ed8d4d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:25.390928 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-405fb2d0-0e00-40f5-a25f-d16f56ed8d4d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:25.391355 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-405fb2d0-0e00-40f5-a25f-d16f56ed8d4d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:25.392028 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-405fb2d0-0e00-40f5-a25f-d16f56ed8d4d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:25.392512 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-405fb2d0-0e00-40f5-a25f-d16f56ed8d4d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:25.392930 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-405fb2d0-0e00-40f5-a25f-d16f56ed8d4d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:25.522423 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-405fb2d0-0e00-40f5-a25f-d16f56ed8d4d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:25.531204 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-405fb2d0-0e00-40f5-a25f-d16f56ed8d4d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1678 microversion: 2.1 time: 0.152170 Oct 24 13:32:25.531719 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 383/763] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:25 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:32:25.941754 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a1cffe84-a4d4-4a15-9fcf-5d921ad2c8a9 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "POST /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.034083 Oct 24 13:32:25.942355 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 381/764] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 24 13:32:24 2022] POST /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/os-volume_attachments => generated 194 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:32:26.167355 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b580d35a-7f56-4898-98fa-adc0666d9b87 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:26.167355 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b580d35a-7f56-4898-98fa-adc0666d9b87 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:26.169871 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b580d35a-7f56-4898-98fa-adc0666d9b87 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:26.170484 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b580d35a-7f56-4898-98fa-adc0666d9b87 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:26.170914 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b580d35a-7f56-4898-98fa-adc0666d9b87 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:26.171602 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b580d35a-7f56-4898-98fa-adc0666d9b87 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:26.172047 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b580d35a-7f56-4898-98fa-adc0666d9b87 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:26.172497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b580d35a-7f56-4898-98fa-adc0666d9b87 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:26.318892 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b580d35a-7f56-4898-98fa-adc0666d9b87 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:26.327272 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b580d35a-7f56-4898-98fa-adc0666d9b87 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1756 microversion: 2.1 time: 0.169164 Oct 24 13:32:26.327836 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 384/765] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:26 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:26.555594 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5e640eb5-216c-44fc-ad77-e04712b4b45a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:26.556313 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5e640eb5-216c-44fc-ad77-e04712b4b45a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:26.562407 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e640eb5-216c-44fc-ad77-e04712b4b45a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:26.562886 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e640eb5-216c-44fc-ad77-e04712b4b45a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:26.563316 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e640eb5-216c-44fc-ad77-e04712b4b45a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:26.563997 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e640eb5-216c-44fc-ad77-e04712b4b45a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:26.564479 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e640eb5-216c-44fc-ad77-e04712b4b45a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:26.564904 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5e640eb5-216c-44fc-ad77-e04712b4b45a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:26.855382 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5e640eb5-216c-44fc-ad77-e04712b4b45a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:26.863145 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5e640eb5-216c-44fc-ad77-e04712b4b45a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1655 microversion: 2.1 time: 0.312394 Oct 24 13:32:26.863717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 382/766] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:26 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1655 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:26.886308 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0d389dea-02ff-479c-86a2-ef597af849ca tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:32:26.893325 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d389dea-02ff-479c-86a2-ef597af849ca tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:26.893797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d389dea-02ff-479c-86a2-ef597af849ca tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:26.894219 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d389dea-02ff-479c-86a2-ef597af849ca tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:26.915465 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0d389dea-02ff-479c-86a2-ef597af849ca tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Going to try to start instance {{(pid=119145) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 13:32:27.066755 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0d389dea-02ff-479c-86a2-ef597af849ca tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "POST /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa/action" status: 202 len: 0 microversion: 2.1 time: 0.184268 Oct 24 13:32:27.067412 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 385/767] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 24 13:32:26 2022] POST /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:32:27.078544 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-dedbdc82-801d-44b8-96c5-432d54a7d754 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:27.079180 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-dedbdc82-801d-44b8-96c5-432d54a7d754 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:27.085601 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dedbdc82-801d-44b8-96c5-432d54a7d754 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:27.086087 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dedbdc82-801d-44b8-96c5-432d54a7d754 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:27.086524 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dedbdc82-801d-44b8-96c5-432d54a7d754 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:27.087211 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dedbdc82-801d-44b8-96c5-432d54a7d754 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:27.087666 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dedbdc82-801d-44b8-96c5-432d54a7d754 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:27.088091 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dedbdc82-801d-44b8-96c5-432d54a7d754 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:27.211309 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-dedbdc82-801d-44b8-96c5-432d54a7d754 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:27.219026 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-dedbdc82-801d-44b8-96c5-432d54a7d754 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1664 microversion: 2.1 time: 0.144536 Oct 24 13:32:27.219582 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 383/768] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:27 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1664 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:27.351295 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-40eb56cd-26b4-41da-bad3-c07a975d6152 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:27.351989 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-40eb56cd-26b4-41da-bad3-c07a975d6152 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:27.358836 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-40eb56cd-26b4-41da-bad3-c07a975d6152 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:27.359395 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-40eb56cd-26b4-41da-bad3-c07a975d6152 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:27.359849 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-40eb56cd-26b4-41da-bad3-c07a975d6152 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:27.360588 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-40eb56cd-26b4-41da-bad3-c07a975d6152 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:27.361043 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-40eb56cd-26b4-41da-bad3-c07a975d6152 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:27.361463 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-40eb56cd-26b4-41da-bad3-c07a975d6152 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:27.504669 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-40eb56cd-26b4-41da-bad3-c07a975d6152 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:27.512987 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-40eb56cd-26b4-41da-bad3-c07a975d6152 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1756 microversion: 2.1 time: 0.166054 Oct 24 13:32:27.513556 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 386/769] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:27 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:28.242378 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-fbb4cad6-5feb-4feb-bd9f-61de36c95b25 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:28.242978 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-fbb4cad6-5feb-4feb-bd9f-61de36c95b25 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:28.249868 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fbb4cad6-5feb-4feb-bd9f-61de36c95b25 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:28.250337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fbb4cad6-5feb-4feb-bd9f-61de36c95b25 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:28.250758 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fbb4cad6-5feb-4feb-bd9f-61de36c95b25 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:28.251436 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fbb4cad6-5feb-4feb-bd9f-61de36c95b25 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:28.251879 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fbb4cad6-5feb-4feb-bd9f-61de36c95b25 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:28.252308 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fbb4cad6-5feb-4feb-bd9f-61de36c95b25 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:28.378646 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fbb4cad6-5feb-4feb-bd9f-61de36c95b25 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:28.386344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-fbb4cad6-5feb-4feb-bd9f-61de36c95b25 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1664 microversion: 2.1 time: 0.147825 Oct 24 13:32:28.387244 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 384/770] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:28 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1664 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:28.536526 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e240d33c-95d3-41e0-8d9a-cfc22c9185a0 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:28.537170 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e240d33c-95d3-41e0-8d9a-cfc22c9185a0 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:28.543572 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e240d33c-95d3-41e0-8d9a-cfc22c9185a0 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:28.544590 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e240d33c-95d3-41e0-8d9a-cfc22c9185a0 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:28.545020 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e240d33c-95d3-41e0-8d9a-cfc22c9185a0 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:28.545728 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e240d33c-95d3-41e0-8d9a-cfc22c9185a0 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:28.546174 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e240d33c-95d3-41e0-8d9a-cfc22c9185a0 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:28.546591 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e240d33c-95d3-41e0-8d9a-cfc22c9185a0 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:28.685593 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e240d33c-95d3-41e0-8d9a-cfc22c9185a0 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:28.693983 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e240d33c-95d3-41e0-8d9a-cfc22c9185a0 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1756 microversion: 2.1 time: 0.161285 Oct 24 13:32:28.694540 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 387/771] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:28 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:29.410254 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-687254c1-2199-45aa-8b35-ad2462fc423e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:29.410871 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-687254c1-2199-45aa-8b35-ad2462fc423e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:29.417248 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-687254c1-2199-45aa-8b35-ad2462fc423e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:29.417733 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-687254c1-2199-45aa-8b35-ad2462fc423e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:29.418158 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-687254c1-2199-45aa-8b35-ad2462fc423e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:29.419350 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-687254c1-2199-45aa-8b35-ad2462fc423e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:29.419802 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-687254c1-2199-45aa-8b35-ad2462fc423e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:29.420228 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-687254c1-2199-45aa-8b35-ad2462fc423e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:29.549314 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-687254c1-2199-45aa-8b35-ad2462fc423e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:29.556935 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-687254c1-2199-45aa-8b35-ad2462fc423e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1664 microversion: 2.1 time: 0.150624 Oct 24 13:32:29.557498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 385/772] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:29 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:29.718092 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6c8650d6-b2b7-4811-933a-48cd94ac93f0 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:29.718669 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-6c8650d6-b2b7-4811-933a-48cd94ac93f0 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:29.725025 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6c8650d6-b2b7-4811-933a-48cd94ac93f0 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:29.725495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6c8650d6-b2b7-4811-933a-48cd94ac93f0 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:29.725948 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6c8650d6-b2b7-4811-933a-48cd94ac93f0 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:29.726622 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6c8650d6-b2b7-4811-933a-48cd94ac93f0 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:29.727067 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6c8650d6-b2b7-4811-933a-48cd94ac93f0 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:29.727481 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6c8650d6-b2b7-4811-933a-48cd94ac93f0 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:29.868446 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-6c8650d6-b2b7-4811-933a-48cd94ac93f0 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:29.876894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6c8650d6-b2b7-4811-933a-48cd94ac93f0 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1756 microversion: 2.1 time: 0.163243 Oct 24 13:32:29.877447 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 388/773] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:29 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:30.581373 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3461125e-b68f-4c03-bb4b-c2e044e1f3b1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:30.581964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-3461125e-b68f-4c03-bb4b-c2e044e1f3b1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:30.588409 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3461125e-b68f-4c03-bb4b-c2e044e1f3b1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:30.591929 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3461125e-b68f-4c03-bb4b-c2e044e1f3b1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:30.591929 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3461125e-b68f-4c03-bb4b-c2e044e1f3b1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:30.591929 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3461125e-b68f-4c03-bb4b-c2e044e1f3b1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:30.591929 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3461125e-b68f-4c03-bb4b-c2e044e1f3b1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:30.592343 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3461125e-b68f-4c03-bb4b-c2e044e1f3b1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:30.721064 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3461125e-b68f-4c03-bb4b-c2e044e1f3b1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:30.729276 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3461125e-b68f-4c03-bb4b-c2e044e1f3b1 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1664 microversion: 2.1 time: 0.152065 Oct 24 13:32:30.730035 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 386/774] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:30 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:30.900470 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-61568310-60db-41b9-bfd1-736a8d73e0c6 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:30.901058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-61568310-60db-41b9-bfd1-736a8d73e0c6 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:30.907498 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-61568310-60db-41b9-bfd1-736a8d73e0c6 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:30.907988 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-61568310-60db-41b9-bfd1-736a8d73e0c6 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:30.908427 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-61568310-60db-41b9-bfd1-736a8d73e0c6 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:30.909096 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-61568310-60db-41b9-bfd1-736a8d73e0c6 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:30.909538 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-61568310-60db-41b9-bfd1-736a8d73e0c6 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:30.909947 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-61568310-60db-41b9-bfd1-736a8d73e0c6 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:31.089888 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-61568310-60db-41b9-bfd1-736a8d73e0c6 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:31.099233 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-61568310-60db-41b9-bfd1-736a8d73e0c6 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1756 microversion: 2.1 time: 0.202603 Oct 24 13:32:31.099804 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 389/775] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:30 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:31.753652 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-22d3f299-4d50-45a7-8bc0-0a17d04a03d9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:31.754260 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-22d3f299-4d50-45a7-8bc0-0a17d04a03d9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:31.760863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-22d3f299-4d50-45a7-8bc0-0a17d04a03d9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:31.761340 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-22d3f299-4d50-45a7-8bc0-0a17d04a03d9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:31.761770 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-22d3f299-4d50-45a7-8bc0-0a17d04a03d9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:31.763058 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-22d3f299-4d50-45a7-8bc0-0a17d04a03d9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:31.763507 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-22d3f299-4d50-45a7-8bc0-0a17d04a03d9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:31.763924 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-22d3f299-4d50-45a7-8bc0-0a17d04a03d9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:31.905148 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-22d3f299-4d50-45a7-8bc0-0a17d04a03d9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:31.913083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-22d3f299-4d50-45a7-8bc0-0a17d04a03d9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1664 microversion: 2.1 time: 0.163177 Oct 24 13:32:31.913650 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 387/776] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:31 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1664 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:32.124214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-d14f85e9-9b19-45b4-88ce-cfc9f063d07c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:32.125003 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-d14f85e9-9b19-45b4-88ce-cfc9f063d07c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:32.135608 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d14f85e9-9b19-45b4-88ce-cfc9f063d07c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:32.135608 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d14f85e9-9b19-45b4-88ce-cfc9f063d07c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:32.135608 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d14f85e9-9b19-45b4-88ce-cfc9f063d07c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:32.135608 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d14f85e9-9b19-45b4-88ce-cfc9f063d07c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:32.136030 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d14f85e9-9b19-45b4-88ce-cfc9f063d07c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:32.136030 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d14f85e9-9b19-45b4-88ce-cfc9f063d07c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:32.280557 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-d14f85e9-9b19-45b4-88ce-cfc9f063d07c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:32.288874 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-d14f85e9-9b19-45b4-88ce-cfc9f063d07c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1756 microversion: 2.1 time: 0.169808 Oct 24 13:32:32.289538 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 390/777] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:32 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:32.936954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-087abecf-ca7b-42bf-aef7-f7f4047f4667 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:32.937589 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-087abecf-ca7b-42bf-aef7-f7f4047f4667 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:32.943887 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-087abecf-ca7b-42bf-aef7-f7f4047f4667 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:32.944390 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-087abecf-ca7b-42bf-aef7-f7f4047f4667 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:32.944819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-087abecf-ca7b-42bf-aef7-f7f4047f4667 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:32.945498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-087abecf-ca7b-42bf-aef7-f7f4047f4667 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:32.946020 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-087abecf-ca7b-42bf-aef7-f7f4047f4667 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:32.946437 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-087abecf-ca7b-42bf-aef7-f7f4047f4667 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:33.080205 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-087abecf-ca7b-42bf-aef7-f7f4047f4667 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:33.089235 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-087abecf-ca7b-42bf-aef7-f7f4047f4667 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1668 microversion: 2.1 time: 0.156069 Oct 24 13:32:33.090066 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 388/778] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:32 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:33.313984 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b69b60bd-2a92-4529-a1a9-2b5cd9a7961c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:33.314689 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b69b60bd-2a92-4529-a1a9-2b5cd9a7961c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:33.321149 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b69b60bd-2a92-4529-a1a9-2b5cd9a7961c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:33.321626 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b69b60bd-2a92-4529-a1a9-2b5cd9a7961c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:33.324354 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b69b60bd-2a92-4529-a1a9-2b5cd9a7961c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:33.324354 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b69b60bd-2a92-4529-a1a9-2b5cd9a7961c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:33.324354 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b69b60bd-2a92-4529-a1a9-2b5cd9a7961c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:33.324354 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b69b60bd-2a92-4529-a1a9-2b5cd9a7961c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:33.468692 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b69b60bd-2a92-4529-a1a9-2b5cd9a7961c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:33.479072 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b69b60bd-2a92-4529-a1a9-2b5cd9a7961c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1756 microversion: 2.1 time: 0.167477 Oct 24 13:32:33.479072 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 391/779] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:33 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:34.500488 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8e513800-8e8c-437f-bd4c-6e2af3b8182c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:34.501116 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8e513800-8e8c-437f-bd4c-6e2af3b8182c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:34.507896 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8e513800-8e8c-437f-bd4c-6e2af3b8182c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:34.508598 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8e513800-8e8c-437f-bd4c-6e2af3b8182c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:34.508891 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8e513800-8e8c-437f-bd4c-6e2af3b8182c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:34.509569 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8e513800-8e8c-437f-bd4c-6e2af3b8182c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:34.510015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8e513800-8e8c-437f-bd4c-6e2af3b8182c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:34.510427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8e513800-8e8c-437f-bd4c-6e2af3b8182c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:34.655323 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8e513800-8e8c-437f-bd4c-6e2af3b8182c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:34.668017 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8e513800-8e8c-437f-bd4c-6e2af3b8182c tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1756 microversion: 2.1 time: 0.171263 Oct 24 13:32:34.668649 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 389/780] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:34 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:35.691884 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-80de0482-51cf-44ce-9c92-c2f19c33b54d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:35.692633 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-80de0482-51cf-44ce-9c92-c2f19c33b54d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:35.699034 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-80de0482-51cf-44ce-9c92-c2f19c33b54d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:35.699507 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-80de0482-51cf-44ce-9c92-c2f19c33b54d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:35.699932 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-80de0482-51cf-44ce-9c92-c2f19c33b54d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:35.700897 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-80de0482-51cf-44ce-9c92-c2f19c33b54d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:35.701342 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-80de0482-51cf-44ce-9c92-c2f19c33b54d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:35.701756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-80de0482-51cf-44ce-9c92-c2f19c33b54d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:35.843213 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-80de0482-51cf-44ce-9c92-c2f19c33b54d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:35.851456 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-80de0482-51cf-44ce-9c92-c2f19c33b54d tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1756 microversion: 2.1 time: 0.163919 Oct 24 13:32:35.852018 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 392/781] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:35 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:36.875252 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8c1a5c25-29f6-4d23-84ea-08bd821d12f9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:36.875851 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8c1a5c25-29f6-4d23-84ea-08bd821d12f9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:36.878404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:36.883130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c1a5c25-29f6-4d23-84ea-08bd821d12f9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:36.883602 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c1a5c25-29f6-4d23-84ea-08bd821d12f9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:36.884027 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c1a5c25-29f6-4d23-84ea-08bd821d12f9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:36.884801 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c1a5c25-29f6-4d23-84ea-08bd821d12f9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:36.885185 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c1a5c25-29f6-4d23-84ea-08bd821d12f9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:36.886837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8c1a5c25-29f6-4d23-84ea-08bd821d12f9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:37.030047 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8c1a5c25-29f6-4d23-84ea-08bd821d12f9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:37.048443 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8c1a5c25-29f6-4d23-84ea-08bd821d12f9 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1756 microversion: 2.1 time: 0.166972 Oct 24 13:32:37.048443 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 390/782] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:36 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:38.061434 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b252d836-ada9-4a9a-bb9d-edea1129e118 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:38.062089 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b252d836-ada9-4a9a-bb9d-edea1129e118 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:38.064640 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=55 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:38.069634 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b252d836-ada9-4a9a-bb9d-edea1129e118 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:38.070236 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b252d836-ada9-4a9a-bb9d-edea1129e118 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:38.073787 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b252d836-ada9-4a9a-bb9d-edea1129e118 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:38.073787 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b252d836-ada9-4a9a-bb9d-edea1129e118 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:38.073787 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b252d836-ada9-4a9a-bb9d-edea1129e118 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:38.073787 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b252d836-ada9-4a9a-bb9d-edea1129e118 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:38.220327 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b252d836-ada9-4a9a-bb9d-edea1129e118 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:38.228498 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b252d836-ada9-4a9a-bb9d-edea1129e118 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1759 microversion: 2.1 time: 0.170931 Oct 24 13:32:38.229056 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 393/783] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:38 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:39.840397 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8026a926-6b76-4afd-b13c-7a5540623b23 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:32:39.842672 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8026a926-6b76-4afd-b13c-7a5540623b23 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:39.849779 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8026a926-6b76-4afd-b13c-7a5540623b23 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:39.850247 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8026a926-6b76-4afd-b13c-7a5540623b23 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:39.850681 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8026a926-6b76-4afd-b13c-7a5540623b23 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:39.851368 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8026a926-6b76-4afd-b13c-7a5540623b23 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:39.851819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8026a926-6b76-4afd-b13c-7a5540623b23 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:39.852242 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8026a926-6b76-4afd-b13c-7a5540623b23 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:39.874252 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.objects.instance [None req-8026a926-6b76-4afd-b13c-7a5540623b23 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lazy-loading 'flavor' on Instance uuid bb595949-cb79-47e4-b760-6e9dfd97b222 {{(pid=119146) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:32:40.162153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:40.257083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8026a926-6b76-4afd-b13c-7a5540623b23 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "POST /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/action" status: 200 len: 32 microversion: 2.1 time: 0.420633 Oct 24 13:32:40.257689 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 391/784] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 24 13:32:39 2022] POST /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/action => generated 32 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:32:40.267786 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ae4a822f-5494-4244-8b72-21a13cc6a2bb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:40.268665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ae4a822f-5494-4244-8b72-21a13cc6a2bb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:40.275415 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ae4a822f-5494-4244-8b72-21a13cc6a2bb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:40.275904 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ae4a822f-5494-4244-8b72-21a13cc6a2bb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:40.276384 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ae4a822f-5494-4244-8b72-21a13cc6a2bb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:40.277066 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ae4a822f-5494-4244-8b72-21a13cc6a2bb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:40.277517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ae4a822f-5494-4244-8b72-21a13cc6a2bb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:40.278048 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ae4a822f-5494-4244-8b72-21a13cc6a2bb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:40.433769 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ae4a822f-5494-4244-8b72-21a13cc6a2bb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:40.441670 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ae4a822f-5494-4244-8b72-21a13cc6a2bb tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.178393 Oct 24 13:32:40.442240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 394/785] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:40 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:41.465874 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-080fe83d-d712-4135-9448-41ba9cb63727 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:41.466635 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-080fe83d-d712-4135-9448-41ba9cb63727 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:41.474478 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-080fe83d-d712-4135-9448-41ba9cb63727 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:41.475011 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-080fe83d-d712-4135-9448-41ba9cb63727 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:41.475437 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-080fe83d-d712-4135-9448-41ba9cb63727 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:41.476116 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-080fe83d-d712-4135-9448-41ba9cb63727 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:41.476593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-080fe83d-d712-4135-9448-41ba9cb63727 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:41.477015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-080fe83d-d712-4135-9448-41ba9cb63727 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:41.606518 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-080fe83d-d712-4135-9448-41ba9cb63727 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:41.615367 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-080fe83d-d712-4135-9448-41ba9cb63727 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.153680 Oct 24 13:32:41.615928 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 392/786] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:41 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:42.638387 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-d74f147b-c569-47c2-88ce-bb78dcb1b1ef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:42.639005 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-d74f147b-c569-47c2-88ce-bb78dcb1b1ef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:42.645707 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d74f147b-c569-47c2-88ce-bb78dcb1b1ef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:42.646389 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d74f147b-c569-47c2-88ce-bb78dcb1b1ef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:42.646822 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d74f147b-c569-47c2-88ce-bb78dcb1b1ef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:42.647505 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d74f147b-c569-47c2-88ce-bb78dcb1b1ef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:42.647954 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d74f147b-c569-47c2-88ce-bb78dcb1b1ef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:42.648405 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d74f147b-c569-47c2-88ce-bb78dcb1b1ef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:42.798003 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-d74f147b-c569-47c2-88ce-bb78dcb1b1ef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:42.806766 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-d74f147b-c569-47c2-88ce-bb78dcb1b1ef tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.172349 Oct 24 13:32:42.807336 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 395/787] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:42 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:43.831492 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-788b757c-2c03-4d79-a775-a387d4a0c851 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:43.832099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-788b757c-2c03-4d79-a775-a387d4a0c851 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:43.838647 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-788b757c-2c03-4d79-a775-a387d4a0c851 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:43.839062 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-788b757c-2c03-4d79-a775-a387d4a0c851 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:43.839488 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-788b757c-2c03-4d79-a775-a387d4a0c851 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:43.840160 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-788b757c-2c03-4d79-a775-a387d4a0c851 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:43.840632 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-788b757c-2c03-4d79-a775-a387d4a0c851 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:43.841045 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-788b757c-2c03-4d79-a775-a387d4a0c851 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:43.970868 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-788b757c-2c03-4d79-a775-a387d4a0c851 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:43.979142 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-788b757c-2c03-4d79-a775-a387d4a0c851 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.152256 Oct 24 13:32:43.980629 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 393/788] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:43 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:45.003150 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f202b5bb-cb94-47aa-a9aa-fa3d69b1f740 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:45.003807 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f202b5bb-cb94-47aa-a9aa-fa3d69b1f740 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:45.010156 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f202b5bb-cb94-47aa-a9aa-fa3d69b1f740 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:45.010634 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f202b5bb-cb94-47aa-a9aa-fa3d69b1f740 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:45.011065 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f202b5bb-cb94-47aa-a9aa-fa3d69b1f740 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:45.011748 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f202b5bb-cb94-47aa-a9aa-fa3d69b1f740 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:45.012196 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f202b5bb-cb94-47aa-a9aa-fa3d69b1f740 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:45.012663 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f202b5bb-cb94-47aa-a9aa-fa3d69b1f740 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:45.158451 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f202b5bb-cb94-47aa-a9aa-fa3d69b1f740 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:45.169588 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f202b5bb-cb94-47aa-a9aa-fa3d69b1f740 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.168041 Oct 24 13:32:45.169588 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 396/789] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:44 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:46.190692 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f51e47f0-e96e-43de-a80c-3cd9ed56f82b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:46.191354 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f51e47f0-e96e-43de-a80c-3cd9ed56f82b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:46.197807 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f51e47f0-e96e-43de-a80c-3cd9ed56f82b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:46.198289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f51e47f0-e96e-43de-a80c-3cd9ed56f82b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:46.198719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f51e47f0-e96e-43de-a80c-3cd9ed56f82b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:46.199401 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f51e47f0-e96e-43de-a80c-3cd9ed56f82b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:46.199851 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f51e47f0-e96e-43de-a80c-3cd9ed56f82b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:46.200285 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f51e47f0-e96e-43de-a80c-3cd9ed56f82b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:46.329444 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f51e47f0-e96e-43de-a80c-3cd9ed56f82b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:46.338495 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f51e47f0-e96e-43de-a80c-3cd9ed56f82b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.152041 Oct 24 13:32:46.340041 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 394/790] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:46 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:47.362572 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a1782ea7-7608-442b-906f-add69bb4c20a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:47.363104 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a1782ea7-7608-442b-906f-add69bb4c20a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:47.369451 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1782ea7-7608-442b-906f-add69bb4c20a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:47.369932 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1782ea7-7608-442b-906f-add69bb4c20a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:47.370356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1782ea7-7608-442b-906f-add69bb4c20a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:47.371026 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1782ea7-7608-442b-906f-add69bb4c20a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:47.371471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1782ea7-7608-442b-906f-add69bb4c20a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:47.371886 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1782ea7-7608-442b-906f-add69bb4c20a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:47.375839 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:32:47.499509 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a1782ea7-7608-442b-906f-add69bb4c20a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:47.508056 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a1782ea7-7608-442b-906f-add69bb4c20a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.149463 Oct 24 13:32:47.508651 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 397/791] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:47 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:48.531673 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a1137a9c-e589-4f06-99ce-3c2af150033e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:48.532300 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a1137a9c-e589-4f06-99ce-3c2af150033e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:48.539377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a1137a9c-e589-4f06-99ce-3c2af150033e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:48.539854 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a1137a9c-e589-4f06-99ce-3c2af150033e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:48.540291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a1137a9c-e589-4f06-99ce-3c2af150033e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:48.540978 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a1137a9c-e589-4f06-99ce-3c2af150033e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:48.541421 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a1137a9c-e589-4f06-99ce-3c2af150033e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:48.541834 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a1137a9c-e589-4f06-99ce-3c2af150033e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:48.670525 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a1137a9c-e589-4f06-99ce-3c2af150033e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:48.678664 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a1137a9c-e589-4f06-99ce-3c2af150033e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.150851 Oct 24 13:32:48.679230 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 395/792] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:48 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:49.702124 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6ddcc7e1-83f2-457c-aa62-b396b60627be tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:49.702733 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-6ddcc7e1-83f2-457c-aa62-b396b60627be tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:49.709201 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ddcc7e1-83f2-457c-aa62-b396b60627be tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:49.709670 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ddcc7e1-83f2-457c-aa62-b396b60627be tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:49.710098 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ddcc7e1-83f2-457c-aa62-b396b60627be tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:49.710770 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ddcc7e1-83f2-457c-aa62-b396b60627be tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:49.711217 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ddcc7e1-83f2-457c-aa62-b396b60627be tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:49.711628 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ddcc7e1-83f2-457c-aa62-b396b60627be tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:49.840671 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-6ddcc7e1-83f2-457c-aa62-b396b60627be tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:49.849327 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6ddcc7e1-83f2-457c-aa62-b396b60627be tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.151312 Oct 24 13:32:49.849892 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 398/793] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:49 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:50.871836 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9afd5e4e-d87b-4e66-8f7a-466214316d64 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:50.872516 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-9afd5e4e-d87b-4e66-8f7a-466214316d64 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:50.879517 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9afd5e4e-d87b-4e66-8f7a-466214316d64 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:50.879998 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9afd5e4e-d87b-4e66-8f7a-466214316d64 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:50.880468 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9afd5e4e-d87b-4e66-8f7a-466214316d64 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:50.881152 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9afd5e4e-d87b-4e66-8f7a-466214316d64 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:50.881601 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9afd5e4e-d87b-4e66-8f7a-466214316d64 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:50.882018 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9afd5e4e-d87b-4e66-8f7a-466214316d64 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:51.006402 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-9afd5e4e-d87b-4e66-8f7a-466214316d64 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:51.014531 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9afd5e4e-d87b-4e66-8f7a-466214316d64 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.146497 Oct 24 13:32:51.015096 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 396/794] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:50 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:51.923096 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-de6aec91-c779-4bb8-a55a-a3b08dac0fc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:51.923586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-de6aec91-c779-4bb8-a55a-a3b08dac0fc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:51.929613 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-de6aec91-c779-4bb8-a55a-a3b08dac0fc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:51.930099 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-de6aec91-c779-4bb8-a55a-a3b08dac0fc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:51.930532 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-de6aec91-c779-4bb8-a55a-a3b08dac0fc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:51.931224 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-de6aec91-c779-4bb8-a55a-a3b08dac0fc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:51.931716 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-de6aec91-c779-4bb8-a55a-a3b08dac0fc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:51.932081 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-de6aec91-c779-4bb8-a55a-a3b08dac0fc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:51.962585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-de6aec91-c779-4bb8-a55a-a3b08dac0fc0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd/os-volume_attachments/a2469b8b-3f89-45c5-98a7-5096f3448753" status: 200 len: 194 microversion: 2.20 time: 0.043597 Oct 24 13:32:51.963335 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 399/795] 10.222.0.48 () {60 vars in 1454 bytes} [Mon Oct 24 13:32:51 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd/os-volume_attachments/a2469b8b-3f89-45c5-98a7-5096f3448753 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:32:52.031149 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-6e113d7c-e527-4cc5-b16c-8bbfb29868a0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:52.031664 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-6e113d7c-e527-4cc5-b16c-8bbfb29868a0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:52.037771 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-2fc4611e-c9bf-4f09-8044-dc040d3cabe1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:52.038375 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6e113d7c-e527-4cc5-b16c-8bbfb29868a0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:52.038513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-2fc4611e-c9bf-4f09-8044-dc040d3cabe1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:52.038853 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6e113d7c-e527-4cc5-b16c-8bbfb29868a0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:52.039282 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6e113d7c-e527-4cc5-b16c-8bbfb29868a0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:52.039968 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6e113d7c-e527-4cc5-b16c-8bbfb29868a0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:52.040441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6e113d7c-e527-4cc5-b16c-8bbfb29868a0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:52.040853 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6e113d7c-e527-4cc5-b16c-8bbfb29868a0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:52.045117 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2fc4611e-c9bf-4f09-8044-dc040d3cabe1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:52.045602 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2fc4611e-c9bf-4f09-8044-dc040d3cabe1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:52.046039 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2fc4611e-c9bf-4f09-8044-dc040d3cabe1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:52.046723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2fc4611e-c9bf-4f09-8044-dc040d3cabe1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:52.047193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2fc4611e-c9bf-4f09-8044-dc040d3cabe1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:52.047615 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2fc4611e-c9bf-4f09-8044-dc040d3cabe1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:52.130087 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.objects.instance [None req-6e113d7c-e527-4cc5-b16c-8bbfb29868a0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lazy-loading 'services' on Instance uuid d3d04bbb-034d-4cf1-a753-9c4cb48e92bd {{(pid=119146) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:32:52.195682 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-2fc4611e-c9bf-4f09-8044-dc040d3cabe1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:52.199430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-2fc4611e-c9bf-4f09-8044-dc040d3cabe1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.165684 Oct 24 13:32:52.199996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 400/796] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:52 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:32:52.297213 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-6e113d7c-e527-4cc5-b16c-8bbfb29868a0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd/os-volume_attachments/a2469b8b-3f89-45c5-98a7-5096f3448753" status: 202 len: 0 microversion: 2.20 time: 0.269684 Oct 24 13:32:52.297801 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 397/797] 10.222.0.48 () {60 vars in 1457 bytes} [Mon Oct 24 13:32:52 2022] DELETE /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd/os-volume_attachments/a2469b8b-3f89-45c5-98a7-5096f3448753 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:32:52.307002 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-975f95d7-4ceb-4465-a620-af6d5c789106 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:52.309438 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-975f95d7-4ceb-4465-a620-af6d5c789106 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:52.315408 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-975f95d7-4ceb-4465-a620-af6d5c789106 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:52.315926 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-975f95d7-4ceb-4465-a620-af6d5c789106 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:52.316985 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-975f95d7-4ceb-4465-a620-af6d5c789106 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:52.317723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-975f95d7-4ceb-4465-a620-af6d5c789106 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:52.318171 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-975f95d7-4ceb-4465-a620-af6d5c789106 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:52.318693 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-975f95d7-4ceb-4465-a620-af6d5c789106 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:52.348481 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-975f95d7-4ceb-4465-a620-af6d5c789106 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045435 Oct 24 13:32:52.349042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 401/798] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Oct 24 13:32:52 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 13:32:53.224199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b0afc234-16bb-4c90-8820-752cf68917b1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:53.224924 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b0afc234-16bb-4c90-8820-752cf68917b1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:53.231446 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b0afc234-16bb-4c90-8820-752cf68917b1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:53.231914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b0afc234-16bb-4c90-8820-752cf68917b1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:53.232405 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b0afc234-16bb-4c90-8820-752cf68917b1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:53.233082 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b0afc234-16bb-4c90-8820-752cf68917b1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:53.233531 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b0afc234-16bb-4c90-8820-752cf68917b1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:53.233945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b0afc234-16bb-4c90-8820-752cf68917b1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:53.365242 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0cb6a56a-d886-47a1-9a3b-71cff6ef912d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:53.365903 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b0afc234-16bb-4c90-8820-752cf68917b1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:53.368687 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0cb6a56a-d886-47a1-9a3b-71cff6ef912d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:53.374606 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b0afc234-16bb-4c90-8820-752cf68917b1 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.154555 Oct 24 13:32:53.375107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0cb6a56a-d886-47a1-9a3b-71cff6ef912d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:53.375614 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0cb6a56a-d886-47a1-9a3b-71cff6ef912d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:53.375751 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 398/799] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:53 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:53.376387 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0cb6a56a-d886-47a1-9a3b-71cff6ef912d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:53.377282 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0cb6a56a-d886-47a1-9a3b-71cff6ef912d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:53.377856 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0cb6a56a-d886-47a1-9a3b-71cff6ef912d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:53.378273 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0cb6a56a-d886-47a1-9a3b-71cff6ef912d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:53.410505 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0cb6a56a-d886-47a1-9a3b-71cff6ef912d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052107 Oct 24 13:32:53.411056 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 402/800] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Oct 24 13:32:53 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:32:54.398767 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b69ead3f-a2c7-481a-99fd-cf580d348b51 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:54.399386 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b69ead3f-a2c7-481a-99fd-cf580d348b51 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:54.405782 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b69ead3f-a2c7-481a-99fd-cf580d348b51 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:54.406264 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b69ead3f-a2c7-481a-99fd-cf580d348b51 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:54.406702 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b69ead3f-a2c7-481a-99fd-cf580d348b51 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:54.407396 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b69ead3f-a2c7-481a-99fd-cf580d348b51 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:54.407855 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b69ead3f-a2c7-481a-99fd-cf580d348b51 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:54.408305 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b69ead3f-a2c7-481a-99fd-cf580d348b51 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:54.423309 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e25ca77c-8a96-46e1-b51a-ea46f965ec4b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:54.425592 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e25ca77c-8a96-46e1-b51a-ea46f965ec4b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:54.432583 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e25ca77c-8a96-46e1-b51a-ea46f965ec4b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:54.433132 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e25ca77c-8a96-46e1-b51a-ea46f965ec4b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:54.433562 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e25ca77c-8a96-46e1-b51a-ea46f965ec4b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:54.434253 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e25ca77c-8a96-46e1-b51a-ea46f965ec4b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:54.434701 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e25ca77c-8a96-46e1-b51a-ea46f965ec4b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:54.435110 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e25ca77c-8a96-46e1-b51a-ea46f965ec4b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:54.471507 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e25ca77c-8a96-46e1-b51a-ea46f965ec4b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052183 Oct 24 13:32:54.472084 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 403/801] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Oct 24 13:32:54 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:32:54.543543 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-4110da85-72e1-4e65-a123-d9bbb1cf3261 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:54.543985 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-4110da85-72e1-4e65-a123-d9bbb1cf3261 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:54.546806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b69ead3f-a2c7-481a-99fd-cf580d348b51 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:54.550080 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4110da85-72e1-4e65-a123-d9bbb1cf3261 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:54.554245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4110da85-72e1-4e65-a123-d9bbb1cf3261 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:54.554245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4110da85-72e1-4e65-a123-d9bbb1cf3261 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:54.554245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4110da85-72e1-4e65-a123-d9bbb1cf3261 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:54.554245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4110da85-72e1-4e65-a123-d9bbb1cf3261 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:54.554658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4110da85-72e1-4e65-a123-d9bbb1cf3261 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:54.555441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b69ead3f-a2c7-481a-99fd-cf580d348b51 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.160517 Oct 24 13:32:54.556017 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 399/802] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:54 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:54.577551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-4110da85-72e1-4e65-a123-d9bbb1cf3261 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Going to try to terminate instance {{(pid=119145) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:32:54.851884 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-4110da85-72e1-4e65-a123-d9bbb1cf3261 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 204 len: 0 microversion: 2.20 time: 0.312397 Oct 24 13:32:54.855808 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 404/803] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 24 13:32:54 2022] DELETE /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 24 13:32:54.861660 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ed934d2e-3919-4942-a559-fc22c46f7645 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:54.862431 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-ed934d2e-3919-4942-a559-fc22c46f7645 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:54.870263 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ed934d2e-3919-4942-a559-fc22c46f7645 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:54.876358 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ed934d2e-3919-4942-a559-fc22c46f7645 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:54.876358 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ed934d2e-3919-4942-a559-fc22c46f7645 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:54.876358 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ed934d2e-3919-4942-a559-fc22c46f7645 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:54.876358 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ed934d2e-3919-4942-a559-fc22c46f7645 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:54.876746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ed934d2e-3919-4942-a559-fc22c46f7645 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:55.043534 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ed934d2e-3919-4942-a559-fc22c46f7645 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:55.052596 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ed934d2e-3919-4942-a559-fc22c46f7645 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:55.053764 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ed934d2e-3919-4942-a559-fc22c46f7645 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:55.054936 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-ed934d2e-3919-4942-a559-fc22c46f7645 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.198001 Oct 24 13:32:55.055495 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 400/804] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:32:54 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:32:55.579702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-65b2640a-3f14-44a7-ae8f-05c7ae52f568 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:55.580436 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-65b2640a-3f14-44a7-ae8f-05c7ae52f568 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:55.586684 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-65b2640a-3f14-44a7-ae8f-05c7ae52f568 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:55.587159 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-65b2640a-3f14-44a7-ae8f-05c7ae52f568 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:55.587584 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-65b2640a-3f14-44a7-ae8f-05c7ae52f568 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:55.588259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-65b2640a-3f14-44a7-ae8f-05c7ae52f568 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:55.588728 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-65b2640a-3f14-44a7-ae8f-05c7ae52f568 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:55.589143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-65b2640a-3f14-44a7-ae8f-05c7ae52f568 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:55.720569 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-65b2640a-3f14-44a7-ae8f-05c7ae52f568 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:55.729682 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-65b2640a-3f14-44a7-ae8f-05c7ae52f568 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.154375 Oct 24 13:32:55.736403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 405/805] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:55 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:56.080749 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-6ccf215e-442e-40a3-82fa-b40cf7ef5665 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:56.084605 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-6ccf215e-442e-40a3-82fa-b40cf7ef5665 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:56.087930 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6ccf215e-442e-40a3-82fa-b40cf7ef5665 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:56.088449 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6ccf215e-442e-40a3-82fa-b40cf7ef5665 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:56.088887 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6ccf215e-442e-40a3-82fa-b40cf7ef5665 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:56.089591 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6ccf215e-442e-40a3-82fa-b40cf7ef5665 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:56.090043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6ccf215e-442e-40a3-82fa-b40cf7ef5665 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:56.090465 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6ccf215e-442e-40a3-82fa-b40cf7ef5665 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:56.221943 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6ccf215e-442e-40a3-82fa-b40cf7ef5665 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:56.230403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6ccf215e-442e-40a3-82fa-b40cf7ef5665 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:56.231833 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6ccf215e-442e-40a3-82fa-b40cf7ef5665 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:56.233023 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-6ccf215e-442e-40a3-82fa-b40cf7ef5665 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.156160 Oct 24 13:32:56.238544 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 401/806] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:32:56 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:32:56.759433 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7018e328-ce2f-4f44-bf49-4e1ac8e55bf8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:56.760257 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-7018e328-ce2f-4f44-bf49-4e1ac8e55bf8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:56.767648 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7018e328-ce2f-4f44-bf49-4e1ac8e55bf8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:56.768532 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7018e328-ce2f-4f44-bf49-4e1ac8e55bf8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:56.769073 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7018e328-ce2f-4f44-bf49-4e1ac8e55bf8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:56.769834 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7018e328-ce2f-4f44-bf49-4e1ac8e55bf8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:56.770349 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7018e328-ce2f-4f44-bf49-4e1ac8e55bf8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:56.770773 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7018e328-ce2f-4f44-bf49-4e1ac8e55bf8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:56.898623 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-7018e328-ce2f-4f44-bf49-4e1ac8e55bf8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:56.906919 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-7018e328-ce2f-4f44-bf49-4e1ac8e55bf8 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.151879 Oct 24 13:32:56.907495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 406/807] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:56 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:57.263004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a287eeb2-a9cf-4f3e-84ec-ede40f384f9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:57.263651 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a287eeb2-a9cf-4f3e-84ec-ede40f384f9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:57.270708 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a287eeb2-a9cf-4f3e-84ec-ede40f384f9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:57.271189 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a287eeb2-a9cf-4f3e-84ec-ede40f384f9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:57.271616 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a287eeb2-a9cf-4f3e-84ec-ede40f384f9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:57.272322 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a287eeb2-a9cf-4f3e-84ec-ede40f384f9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:57.272764 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a287eeb2-a9cf-4f3e-84ec-ede40f384f9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:57.273187 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a287eeb2-a9cf-4f3e-84ec-ede40f384f9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:57.624075 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a287eeb2-a9cf-4f3e-84ec-ede40f384f9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:57.633470 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a287eeb2-a9cf-4f3e-84ec-ede40f384f9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:57.634949 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a287eeb2-a9cf-4f3e-84ec-ede40f384f9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:57.636134 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a287eeb2-a9cf-4f3e-84ec-ede40f384f9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1721 microversion: 2.20 time: 0.377153 Oct 24 13:32:57.636728 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 402/808] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:32:57 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1721 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:32:57.931249 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9331fa7d-b846-4319-82ac-5c6d77759992 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:57.931852 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9331fa7d-b846-4319-82ac-5c6d77759992 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:57.938274 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9331fa7d-b846-4319-82ac-5c6d77759992 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:57.938967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9331fa7d-b846-4319-82ac-5c6d77759992 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:57.939395 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9331fa7d-b846-4319-82ac-5c6d77759992 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:57.940076 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9331fa7d-b846-4319-82ac-5c6d77759992 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:57.940544 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9331fa7d-b846-4319-82ac-5c6d77759992 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:57.940963 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9331fa7d-b846-4319-82ac-5c6d77759992 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:58.133236 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9331fa7d-b846-4319-82ac-5c6d77759992 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:58.145681 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9331fa7d-b846-4319-82ac-5c6d77759992 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.218342 Oct 24 13:32:58.147134 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 407/809] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:57 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:58.556244 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-1b8670fb-cafe-44e9-b3ef-b59c81ce68ee req-14093c72-3976-44d0-b50c-10fa9411fa63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d04bbb-034d-4cf1-a753-9c4cb48e92bd", "name": "network-vif-deleted", "tag": "4dfc7079-30d9-488d-9dfc-1df75d250b32"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:32:58.584604 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-1b8670fb-cafe-44e9-b3ef-b59c81ce68ee req-14093c72-3976-44d0-b50c-10fa9411fa63 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:58.585810 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-1b8670fb-cafe-44e9-b3ef-b59c81ce68ee req-14093c72-3976-44d0-b50c-10fa9411fa63 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:58.586321 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-1b8670fb-cafe-44e9-b3ef-b59c81ce68ee req-14093c72-3976-44d0-b50c-10fa9411fa63 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:58.599255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-1b8670fb-cafe-44e9-b3ef-b59c81ce68ee req-14093c72-3976-44d0-b50c-10fa9411fa63 service nova] Creating event network-vif-deleted:4dfc7079-30d9-488d-9dfc-1df75d250b32 for instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd on hv-cinder-86249 Oct 24 13:32:58.605564 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-1b8670fb-cafe-44e9-b3ef-b59c81ce68ee req-14093c72-3976-44d0-b50c-10fa9411fa63 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052209 Oct 24 13:32:58.606241 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 403/810] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:32:58.662293 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-daa54ed6-34e7-4244-9c67-08cacd338709 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:58.662899 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-daa54ed6-34e7-4244-9c67-08cacd338709 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:58.669370 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-daa54ed6-34e7-4244-9c67-08cacd338709 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:58.672872 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-daa54ed6-34e7-4244-9c67-08cacd338709 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:58.672872 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-daa54ed6-34e7-4244-9c67-08cacd338709 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:58.672872 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-daa54ed6-34e7-4244-9c67-08cacd338709 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:58.672872 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-daa54ed6-34e7-4244-9c67-08cacd338709 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:58.673311 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-daa54ed6-34e7-4244-9c67-08cacd338709 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:58.745203 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-daa54ed6-34e7-4244-9c67-08cacd338709 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:58.755678 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-daa54ed6-34e7-4244-9c67-08cacd338709 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:58.757554 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-daa54ed6-34e7-4244-9c67-08cacd338709 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:58.758916 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-daa54ed6-34e7-4244-9c67-08cacd338709 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1653 microversion: 2.20 time: 0.100887 Oct 24 13:32:58.760222 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 408/811] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:32:58 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1653 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:32:59.170496 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8ed77d5f-1c2e-4485-a21a-5ad6c03d347b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:59.171188 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8ed77d5f-1c2e-4485-a21a-5ad6c03d347b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:59.179475 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8ed77d5f-1c2e-4485-a21a-5ad6c03d347b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:59.181971 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8ed77d5f-1c2e-4485-a21a-5ad6c03d347b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:59.183635 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8ed77d5f-1c2e-4485-a21a-5ad6c03d347b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:59.184543 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8ed77d5f-1c2e-4485-a21a-5ad6c03d347b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:59.185151 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8ed77d5f-1c2e-4485-a21a-5ad6c03d347b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:59.185769 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8ed77d5f-1c2e-4485-a21a-5ad6c03d347b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:59.369187 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8ed77d5f-1c2e-4485-a21a-5ad6c03d347b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:59.389124 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8ed77d5f-1c2e-4485-a21a-5ad6c03d347b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.222805 Oct 24 13:32:59.393695 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 404/812] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:32:59 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:32:59.788315 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-d1a2b107-1075-4f22-b302-15ab37e26ffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:32:59.792398 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-d1a2b107-1075-4f22-b302-15ab37e26ffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:32:59.797593 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d1a2b107-1075-4f22-b302-15ab37e26ffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:59.798638 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d1a2b107-1075-4f22-b302-15ab37e26ffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:59.799892 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d1a2b107-1075-4f22-b302-15ab37e26ffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:59.801187 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d1a2b107-1075-4f22-b302-15ab37e26ffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:59.801635 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d1a2b107-1075-4f22-b302-15ab37e26ffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:59.802047 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d1a2b107-1075-4f22-b302-15ab37e26ffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:59.841270 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d1a2b107-1075-4f22-b302-15ab37e26ffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:32:59.841673 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d1a2b107-1075-4f22-b302-15ab37e26ffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:32:59.842099 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d1a2b107-1075-4f22-b302-15ab37e26ffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:32:59.842796 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.objects.instance [None req-d1a2b107-1075-4f22-b302-15ab37e26ffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lazy-loading 'fault' on Instance uuid d3d04bbb-034d-4cf1-a753-9c4cb48e92bd {{(pid=119145) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:32:59.895727 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-d1a2b107-1075-4f22-b302-15ab37e26ffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:59.904124 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-d1a2b107-1075-4f22-b302-15ab37e26ffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:59.907339 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-d1a2b107-1075-4f22-b302-15ab37e26ffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:32:59.912009 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-d1a2b107-1075-4f22-b302-15ab37e26ffd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 200 len: 1369 microversion: 2.20 time: 0.125608 Oct 24 13:32:59.913201 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 409/813] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:32:59 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 1369 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:33:00.416090 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3e86e251-5a6c-4d80-896f-d942e1747cab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:00.417498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-3e86e251-5a6c-4d80-896f-d942e1747cab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:00.440319 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3e86e251-5a6c-4d80-896f-d942e1747cab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:00.441984 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3e86e251-5a6c-4d80-896f-d942e1747cab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:00.442601 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3e86e251-5a6c-4d80-896f-d942e1747cab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:00.443650 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3e86e251-5a6c-4d80-896f-d942e1747cab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:00.444412 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3e86e251-5a6c-4d80-896f-d942e1747cab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:00.445011 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3e86e251-5a6c-4d80-896f-d942e1747cab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:00.820095 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3e86e251-5a6c-4d80-896f-d942e1747cab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:00.841261 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3e86e251-5a6c-4d80-896f-d942e1747cab tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.427570 Oct 24 13:33:00.844740 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 405/814] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:00 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:00.942150 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ad4d8376-38dc-4d71-a77f-45073ed26a00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:00.942150 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ad4d8376-38dc-4d71-a77f-45073ed26a00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:00.950164 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ad4d8376-38dc-4d71-a77f-45073ed26a00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:00.953129 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ad4d8376-38dc-4d71-a77f-45073ed26a00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:00.953764 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ad4d8376-38dc-4d71-a77f-45073ed26a00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:00.954479 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ad4d8376-38dc-4d71-a77f-45073ed26a00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:00.954929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ad4d8376-38dc-4d71-a77f-45073ed26a00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:00.955343 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ad4d8376-38dc-4d71-a77f-45073ed26a00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:00.989353 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-ad4d8376-38dc-4d71-a77f-45073ed26a00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] HTTP exception thrown: Instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd could not be found. Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ad4d8376-38dc-4d71-a77f-45073ed26a00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Request method failure captured: Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd HTTP/1.1 Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpJIJlZfhLxtl3ybqFAHBF4hNfiQidPCZew-g-H2ZJi2ilBgsXFfUiBEKW27b8Am-r1yHzD-vve5LgLklHsX2jQdaUVAIm-ayHErSjRpeWKcNkuhZf7OmTVJNTOKZaWzaQsoAVnXS_t_jsnbodpeJ7a1I3tJ2pREXRAEg8NZcbL0BCc Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: 7fa2196e343c45b5b741c39417ba9ef8 Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1521868781 Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:33:00.991008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:33:00.992784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7fa2196e343c45b5b741c39417ba9ef8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7fa2196e343c45b5b741c39417ba9ef8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7fa2196e343c45b5b741c39417ba9ef8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7fa2196e343c45b5b741c39417ba9ef8"}]}] Oct 24 13:33:00.992784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1521868781 Oct 24 13:33:00.992784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: 7fa2196e343c45b5b741c39417ba9ef8 Oct 24 13:33:00.992784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1521868781 Oct 24 13:33:00.992784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-AttachVolumeShelveTestJSON-1521868781-project Oct 24 13:33:00.992784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:33:00.992784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:33:00.992784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 7c096064e6ec443a9e8755bc2e68dbb7 Oct 24 13:33:00.992784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1521868781-project Oct 24 13:33:00.992784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:33:00.992784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd could not be found. Oct 24 13:33:00.992784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': 'd3d04bbb-034d-4cf1-a753-9c4cb48e92bd'} Oct 24 13:33:00.993797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:33:00.993797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:33:00.993797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:33:00.993797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:33:00.993797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:33:00.993797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:33:00.993797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:33:00.993797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:33:00.993797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:33:00.993797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:33:00.993797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd could not be found. Oct 24 13:33:00.993797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:33:00.993797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:33:00.993797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:33:00.993797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:33:00.993797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:33:00.993797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:33:00.993797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:33:00.993797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:33:00.993797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:33:00.995356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:33:00.995356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:33:00.995356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:33:00.995356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:33:00.995356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:33:00.995356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:33:00.995356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:33:00.995356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd could not be found. Oct 24 13:33:00.995356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:33:00.995356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:33:00.995356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:33:00.995356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:33:00.995356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:33:00.995356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:33:00.995356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:33:00.995356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:33:00.995356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd could not be found. Oct 24 13:33:00.995356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:33:00.996807 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ad4d8376-38dc-4d71-a77f-45073ed26a00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Returning 404 to user: Instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:33:01.000416 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ad4d8376-38dc-4d71-a77f-45073ed26a00 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 404 len: 111 microversion: 2.20 time: 0.056555 Oct 24 13:33:01.002394 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 410/815] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:33:00 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:33:01.011494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-121bd0d0-85d0-41e3-b142-37f6f76699d9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '.version_select at 0x7f17a3ff75e0>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:01.100579 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-121bd0d0-85d0-41e3-b142-37f6f76699d9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-125058714" status: 204 len: 0 microversion: 2.20 time: 0.093015 Oct 24 13:33:01.101485 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 406/816] 10.222.0.48 () {60 vars in 1259 bytes} [Mon Oct 24 13:33:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-125058714 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 13:33:01.876027 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-80d474c8-7f5e-4527-9da9-553aefa32f2b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:01.876672 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-80d474c8-7f5e-4527-9da9-553aefa32f2b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:01.888351 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-80d474c8-7f5e-4527-9da9-553aefa32f2b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:01.888852 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-80d474c8-7f5e-4527-9da9-553aefa32f2b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:01.889815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-80d474c8-7f5e-4527-9da9-553aefa32f2b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:01.889991 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-80d474c8-7f5e-4527-9da9-553aefa32f2b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:01.890442 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-80d474c8-7f5e-4527-9da9-553aefa32f2b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:01.890864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-80d474c8-7f5e-4527-9da9-553aefa32f2b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:02.132214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-80d474c8-7f5e-4527-9da9-553aefa32f2b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:02.154140 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-115c7c6a-e803-45c3-b7cd-f719dbadf042 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Action: 'create', calling method: .version_select at 0x7f17a3f98280>, body: {"keypair": {"name": "tempest-keypair-1241452208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLm0kC4t7UvLat95PKZRKRqEUX7Hvvi1PtxXMNx5H6OyjR3UlQ2kKBdbLLmrA/7LB0J9HT++zBfPmAFk2O9y/D+U7pf9bTEIVEhjQSahLdi8KQ9eEnHKp2Y31HiWOqt1Gg=="}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:33:02.159227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-80d474c8-7f5e-4527-9da9-553aefa32f2b tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.287348 Oct 24 13:33:02.159227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 411/817] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:01 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:02.172932 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-115c7c6a-e803-45c3-b7cd-f719dbadf042 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Getting quotas for project 7fa2196e343c45b5b741c39417ba9ef8. Resources: {'key_pairs'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:33:02.178564 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-115c7c6a-e803-45c3-b7cd-f719dbadf042 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Getting quotas for user 7c096064e6ec443a9e8755bc2e68dbb7 and project 7fa2196e343c45b5b741c39417ba9ef8. Resources: {'key_pairs'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:33:02.276877 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-115c7c6a-e803-45c3-b7cd-f719dbadf042 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.126891 Oct 24 13:33:02.277786 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 407/818] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Oct 24 13:33:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 24 13:33:03.183007 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9087f111-779b-4d36-9007-2cac3002326f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:03.183644 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9087f111-779b-4d36-9007-2cac3002326f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:03.190256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9087f111-779b-4d36-9007-2cac3002326f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:03.190745 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9087f111-779b-4d36-9007-2cac3002326f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:03.191231 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9087f111-779b-4d36-9007-2cac3002326f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:03.191999 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9087f111-779b-4d36-9007-2cac3002326f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:03.192406 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9087f111-779b-4d36-9007-2cac3002326f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:03.192989 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9087f111-779b-4d36-9007-2cac3002326f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:03.213828 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:03.359614 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9087f111-779b-4d36-9007-2cac3002326f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:03.368574 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9087f111-779b-4d36-9007-2cac3002326f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.189460 Oct 24 13:33:03.369150 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 412/819] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:03 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:04.393568 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ee273ac0-18ec-4649-845c-aec7d72db7c2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:04.402243 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-ee273ac0-18ec-4649-845c-aec7d72db7c2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:04.402243 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee273ac0-18ec-4649-845c-aec7d72db7c2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:04.402243 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee273ac0-18ec-4649-845c-aec7d72db7c2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:04.403458 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee273ac0-18ec-4649-845c-aec7d72db7c2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:04.404168 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee273ac0-18ec-4649-845c-aec7d72db7c2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:04.404669 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee273ac0-18ec-4649-845c-aec7d72db7c2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:04.405226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee273ac0-18ec-4649-845c-aec7d72db7c2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:04.621727 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ee273ac0-18ec-4649-845c-aec7d72db7c2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:04.632334 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-ee273ac0-18ec-4649-845c-aec7d72db7c2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1732 microversion: 2.1 time: 0.243945 Oct 24 13:33:04.633269 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 408/820] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:04 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1732 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:05.316934 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-25533474-fadd-453e-9c59-8190978d73f3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-909712704", "imageRef": "1a874490-179e-412c-895e-52b16935c04c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "958bd8a2-e988-4f21-ad22-567c0fb9f577"}], "security_groups": [{"name": "tempest-securitygroup--159454166"}], "key_name": "tempest-keypair-1241452208", "user_data": "}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:33:05.430737 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.network.neutron [None req-25533474-fadd-453e-9c59-8190978d73f3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] validate_networks() for [('958bd8a2-e988-4f21-ad22-567c0fb9f577', None, None, None, None, None)] {{(pid=119145) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:33:05.657364 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-d3861bd5-89d3-4fad-a790-26d3487e64da tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:05.658682 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-d3861bd5-89d3-4fad-a790-26d3487e64da tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:05.669545 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d3861bd5-89d3-4fad-a790-26d3487e64da tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:05.670052 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d3861bd5-89d3-4fad-a790-26d3487e64da tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:05.670494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d3861bd5-89d3-4fad-a790-26d3487e64da tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:05.671222 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d3861bd5-89d3-4fad-a790-26d3487e64da tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:05.671675 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d3861bd5-89d3-4fad-a790-26d3487e64da tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:05.672096 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d3861bd5-89d3-4fad-a790-26d3487e64da tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:05.913798 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-d3861bd5-89d3-4fad-a790-26d3487e64da tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:05.928934 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-d3861bd5-89d3-4fad-a790-26d3487e64da tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1712 microversion: 2.1 time: 0.275900 Oct 24 13:33:05.930467 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 409/821] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:05 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1712 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:06.092573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-25533474-fadd-453e-9c59-8190978d73f3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Flavor limits 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:33:06.092573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-25533474-fadd-453e-9c59-8190978d73f3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Image limits 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:33:06.093657 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-25533474-fadd-453e-9c59-8190978d73f3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Flavor pref 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:33:06.093657 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-25533474-fadd-453e-9c59-8190978d73f3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Image pref 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:33:06.093978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-25533474-fadd-453e-9c59-8190978d73f3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:33:06.104302 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-25533474-fadd-453e-9c59-8190978d73f3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:06.104782 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-25533474-fadd-453e-9c59-8190978d73f3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:06.105203 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-25533474-fadd-453e-9c59-8190978d73f3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:06.105912 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-25533474-fadd-453e-9c59-8190978d73f3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:06.106349 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-25533474-fadd-453e-9c59-8190978d73f3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:06.106756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-25533474-fadd-453e-9c59-8190978d73f3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:06.119508 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-6d9c1660-17ba-4ac8-8f87-e8f5697c159e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:06.120209 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-6d9c1660-17ba-4ac8-8f87-e8f5697c159e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:06.136948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6d9c1660-17ba-4ac8-8f87-e8f5697c159e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:06.137580 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6d9c1660-17ba-4ac8-8f87-e8f5697c159e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:06.138132 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6d9c1660-17ba-4ac8-8f87-e8f5697c159e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:06.139009 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6d9c1660-17ba-4ac8-8f87-e8f5697c159e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:06.141110 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6d9c1660-17ba-4ac8-8f87-e8f5697c159e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:06.141661 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6d9c1660-17ba-4ac8-8f87-e8f5697c159e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:06.142112 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-25533474-fadd-453e-9c59-8190978d73f3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Getting quotas for project 7fa2196e343c45b5b741c39417ba9ef8. Resources: {'ram', 'instances', 'cores'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:33:06.147808 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-25533474-fadd-453e-9c59-8190978d73f3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Getting quotas for user 7c096064e6ec443a9e8755bc2e68dbb7 and project 7fa2196e343c45b5b741c39417ba9ef8. Resources: {'ram', 'instances', 'cores'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:33:06.165756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-25533474-fadd-453e-9c59-8190978d73f3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Going to run 1 instances... {{(pid=119145) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:33:06.169989 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-25533474-fadd-453e-9c59-8190978d73f3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a874490-179e-412c-895e-52b16935c04c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119145) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:33:06.172184 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:06.266468 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-6d9c1660-17ba-4ac8-8f87-e8f5697c159e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] HTTP exception thrown: Cannot 'detach_volume' instance bb595949-cb79-47e4-b760-6e9dfd97b222 while it is in vm_state rescued Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-6d9c1660-17ba-4ac8-8f87-e8f5697c159e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Request method failure captured: Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: DELETE /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/os-volume_attachments/0b38a74e-70d4-4d07-a5f5-6b75e3238bbe HTTP/1.1 Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpJKIq5Rg50YSGQIjea3FRN8mTaXpsN5dA41WiaGbVh9lcQUtvdp2bBedjxQrf6lA7EHcL6QKUXInDPdjkl_Ihu9evaGWoTz8qUtj4HiB1zTeWk0JDMERKf8vFbcZFV6NCEsUhI2fpefVy7T0gdhukP3dZAyqmypjxu54EdjX60vHfw Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 986792b802264c748e4614c4d2a17680 Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-440406220 Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:33:06.268084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:33:06.269693 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_986792b802264c748e4614c4d2a17680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/986792b802264c748e4614c4d2a17680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/986792b802264c748e4614c4d2a17680"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/986792b802264c748e4614c4d2a17680"}]}] Oct 24 13:33:06.269693 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-ServerRescueNegativeTestJSON-440406220 Oct 24 13:33:06.269693 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 986792b802264c748e4614c4d2a17680 Oct 24 13:33:06.269693 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-440406220 Oct 24 13:33:06.269693 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-ServerRescueNegativeTestJSON-440406220-project Oct 24 13:33:06.269693 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:33:06.269693 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:33:06.269693 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 633c6c68e15f4be9a7289d15cac9de43 Oct 24 13:33:06.269693 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-ServerRescueNegativeTestJSON-440406220-project Oct 24 13:33:06.269693 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:33:06.269693 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Cannot 'detach_volume' instance bb595949-cb79-47e4-b760-6e9dfd97b222 while it is in vm_state rescued Oct 24 13:33:06.270645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'server_id': 'bb595949-cb79-47e4-b760-6e9dfd97b222', 'id': '0b38a74e-70d4-4d07-a5f5-6b75e3238bbe'} Oct 24 13:33:06.270645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:33:06.270645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:33:06.270645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 24 13:33:06.270645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 24 13:33:06.270645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 13:33:06.270645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 13:33:06.270645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 13:33:06.270645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 13:33:06.270645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bb595949-cb79-47e4-b760-6e9dfd97b222 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 24 13:33:06.270645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:33:06.270645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:33:06.270645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:33:06.270645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:33:06.270645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:33:06.270645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:33:06.270645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:33:06.270645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:33:06.270645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:33:06.270645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:33:06.272289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 24 13:33:06.272289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 13:33:06.272289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 13:33:06.272289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 13:33:06.272289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance bb595949-cb79-47e4-b760-6e9dfd97b222 while it is in vm_state rescued Oct 24 13:33:06.272289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:33:06.272289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:33:06.272289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:33:06.272289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:33:06.272289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:33:06.272289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:33:06.272289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:33:06.272289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:33:06.272289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance bb595949-cb79-47e4-b760-6e9dfd97b222 while it is in vm_state rescued Oct 24 13:33:06.272289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:33:06.272289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-6d9c1660-17ba-4ac8-8f87-e8f5697c159e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Returning 409 to user: Cannot 'detach_volume' instance bb595949-cb79-47e4-b760-6e9dfd97b222 while it is in vm_state rescued {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:33:06.273664 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-6d9c1660-17ba-4ac8-8f87-e8f5697c159e tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/os-volume_attachments/0b38a74e-70d4-4d07-a5f5-6b75e3238bbe" status: 409 len: 152 microversion: 2.1 time: 0.161407 Oct 24 13:33:06.273664 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 410/822] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 24 13:33:06 2022] DELETE /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/os-volume_attachments/0b38a74e-70d4-4d07-a5f5-6b75e3238bbe => generated 152 bytes in 163 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 24 13:33:06.283498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-09d5b1d5-7111-43d8-86bb-1b09cad05237 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:33:06.285744 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-09d5b1d5-7111-43d8-86bb-1b09cad05237 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:06.293637 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-09d5b1d5-7111-43d8-86bb-1b09cad05237 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:06.295152 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-09d5b1d5-7111-43d8-86bb-1b09cad05237 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:06.296077 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-09d5b1d5-7111-43d8-86bb-1b09cad05237 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:06.297001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-09d5b1d5-7111-43d8-86bb-1b09cad05237 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:06.297622 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-09d5b1d5-7111-43d8-86bb-1b09cad05237 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:06.298213 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-09d5b1d5-7111-43d8-86bb-1b09cad05237 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:06.342470 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-25533474-fadd-453e-9c59-8190978d73f3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.030139 Oct 24 13:33:06.350366 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 413/823] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Oct 24 13:33:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 13:33:06.355497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e15ba001-3148-4804-a543-ce4d3d7b6d80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:06.356501 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e15ba001-3148-4804-a543-ce4d3d7b6d80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:06.449387 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e15ba001-3148-4804-a543-ce4d3d7b6d80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:06.465316 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e15ba001-3148-4804-a543-ce4d3d7b6d80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:06.466863 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e15ba001-3148-4804-a543-ce4d3d7b6d80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:06.468015 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e15ba001-3148-4804-a543-ce4d3d7b6d80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1281 microversion: 2.20 time: 0.116371 Oct 24 13:33:06.491854 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 414/824] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:33:06 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1281 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:33:06.558516 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-09d5b1d5-7111-43d8-86bb-1b09cad05237 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "POST /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/action" status: 202 len: 0 microversion: 2.1 time: 0.282318 Oct 24 13:33:06.567422 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 411/825] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 24 13:33:06 2022] POST /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:33:06.577137 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0d091c51-c4c8-4e3b-8cc7-d5b7a68863ad tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:06.578372 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0d091c51-c4c8-4e3b-8cc7-d5b7a68863ad tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:06.594854 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d091c51-c4c8-4e3b-8cc7-d5b7a68863ad tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:06.596684 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d091c51-c4c8-4e3b-8cc7-d5b7a68863ad tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:06.599980 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d091c51-c4c8-4e3b-8cc7-d5b7a68863ad tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:06.601974 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d091c51-c4c8-4e3b-8cc7-d5b7a68863ad tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:06.604057 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d091c51-c4c8-4e3b-8cc7-d5b7a68863ad tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:06.605713 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d091c51-c4c8-4e3b-8cc7-d5b7a68863ad tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:06.928537 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0d091c51-c4c8-4e3b-8cc7-d5b7a68863ad tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:06.940442 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0d091c51-c4c8-4e3b-8cc7-d5b7a68863ad tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1720 microversion: 2.1 time: 0.368467 Oct 24 13:33:06.941825 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 415/826] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:06 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1720 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:07.495688 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-41ecc5a7-5c3a-4e99-abf5-777cc1547773 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:07.496541 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-41ecc5a7-5c3a-4e99-abf5-777cc1547773 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:07.502606 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:07.568993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-41ecc5a7-5c3a-4e99-abf5-777cc1547773 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:07.577812 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-41ecc5a7-5c3a-4e99-abf5-777cc1547773 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:07.579391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-41ecc5a7-5c3a-4e99-abf5-777cc1547773 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:07.581388 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-41ecc5a7-5c3a-4e99-abf5-777cc1547773 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1281 microversion: 2.20 time: 0.091597 Oct 24 13:33:07.581995 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 412/827] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:33:07 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1281 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:33:07.966053 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e32c50ff-e743-4b92-86d2-c1229b8c970f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:07.966746 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e32c50ff-e743-4b92-86d2-c1229b8c970f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:07.974850 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e32c50ff-e743-4b92-86d2-c1229b8c970f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:07.984468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e32c50ff-e743-4b92-86d2-c1229b8c970f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:07.984468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e32c50ff-e743-4b92-86d2-c1229b8c970f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:07.984468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e32c50ff-e743-4b92-86d2-c1229b8c970f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:07.984468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e32c50ff-e743-4b92-86d2-c1229b8c970f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:07.984910 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e32c50ff-e743-4b92-86d2-c1229b8c970f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:08.162581 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e32c50ff-e743-4b92-86d2-c1229b8c970f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:08.174363 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e32c50ff-e743-4b92-86d2-c1229b8c970f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1720 microversion: 2.1 time: 0.212829 Oct 24 13:33:08.176111 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 416/828] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:07 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:08.609563 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7a66786f-52e2-45b2-96e9-1218113e3109 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:08.610725 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7a66786f-52e2-45b2-96e9-1218113e3109 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:08.620492 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7a66786f-52e2-45b2-96e9-1218113e3109 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:08.620985 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7a66786f-52e2-45b2-96e9-1218113e3109 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:08.621423 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7a66786f-52e2-45b2-96e9-1218113e3109 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:08.627010 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7a66786f-52e2-45b2-96e9-1218113e3109 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:08.627493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7a66786f-52e2-45b2-96e9-1218113e3109 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:08.627943 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7a66786f-52e2-45b2-96e9-1218113e3109 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:08.720403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7a66786f-52e2-45b2-96e9-1218113e3109 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:08.736992 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7a66786f-52e2-45b2-96e9-1218113e3109 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:08.739023 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7a66786f-52e2-45b2-96e9-1218113e3109 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:08.740148 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7a66786f-52e2-45b2-96e9-1218113e3109 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1277 microversion: 2.20 time: 0.134478 Oct 24 13:33:08.740807 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 413/829] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:33:08 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1277 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:33:09.202929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-17fc1e53-7149-4301-ac30-50444cc70bd7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:09.204160 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-17fc1e53-7149-4301-ac30-50444cc70bd7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:09.209680 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:09.213414 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-17fc1e53-7149-4301-ac30-50444cc70bd7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:09.219618 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-17fc1e53-7149-4301-ac30-50444cc70bd7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:09.220169 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-17fc1e53-7149-4301-ac30-50444cc70bd7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:09.221275 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-17fc1e53-7149-4301-ac30-50444cc70bd7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:09.221734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-17fc1e53-7149-4301-ac30-50444cc70bd7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:09.222393 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-17fc1e53-7149-4301-ac30-50444cc70bd7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:09.364363 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-17fc1e53-7149-4301-ac30-50444cc70bd7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:09.374724 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-17fc1e53-7149-4301-ac30-50444cc70bd7 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1720 microversion: 2.1 time: 0.178645 Oct 24 13:33:09.375322 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 417/830] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:09 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:09.766234 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7197a965-ca73-46a7-a486-f2872d5aa519 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:09.767628 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7197a965-ca73-46a7-a486-f2872d5aa519 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:09.775399 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7197a965-ca73-46a7-a486-f2872d5aa519 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:09.779264 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7197a965-ca73-46a7-a486-f2872d5aa519 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:09.779904 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7197a965-ca73-46a7-a486-f2872d5aa519 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:09.780671 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7197a965-ca73-46a7-a486-f2872d5aa519 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:09.781304 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7197a965-ca73-46a7-a486-f2872d5aa519 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:09.781733 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7197a965-ca73-46a7-a486-f2872d5aa519 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:09.879813 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7197a965-ca73-46a7-a486-f2872d5aa519 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:09.888971 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7197a965-ca73-46a7-a486-f2872d5aa519 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:09.890443 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7197a965-ca73-46a7-a486-f2872d5aa519 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:09.891794 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7197a965-ca73-46a7-a486-f2872d5aa519 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1333 microversion: 2.20 time: 0.129375 Oct 24 13:33:09.892451 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 414/831] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:33:09 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1333 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:33:10.412106 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-39b136c0-48ef-4fbc-be74-c83c7f0559d6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:10.412106 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-39b136c0-48ef-4fbc-be74-c83c7f0559d6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:10.426206 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-39b136c0-48ef-4fbc-be74-c83c7f0559d6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:10.427328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-39b136c0-48ef-4fbc-be74-c83c7f0559d6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:10.427936 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-39b136c0-48ef-4fbc-be74-c83c7f0559d6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:10.429086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-39b136c0-48ef-4fbc-be74-c83c7f0559d6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:10.429539 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-39b136c0-48ef-4fbc-be74-c83c7f0559d6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:10.430284 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-39b136c0-48ef-4fbc-be74-c83c7f0559d6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:10.523295 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7cc35f77-c8c9-4433-85f7-3d6d73e1d0c0 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Action: 'create', calling method: .version_select at 0x7f17ab93ec10>, body: {"keypair": {"name": "tempest-TestShelveInstance-615995550", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCds7h3JsVD+FibnTmdnJ2fVjkj903jpQ96ZIP4HFbi+Q+4lhxxuTIh3WBu9X+envFHzSv4RIj3cGZXNO/JRMPvMGYoYt4aY9C6acazZ3OzWEmu1HF/c8QGUZZoT8OzLjQ=="}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:33:10.542186 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-7cc35f77-c8c9-4433-85f7-3d6d73e1d0c0 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Getting quotas for project a946788afc074f079618f1a848ec0f8c. Resources: {'key_pairs'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:33:10.546495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-7cc35f77-c8c9-4433-85f7-3d6d73e1d0c0 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Getting quotas for user 33af9a4e3c29426b90dfd5abebde5ed4 and project a946788afc074f079618f1a848ec0f8c. Resources: {'key_pairs'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:33:10.615213 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-39b136c0-48ef-4fbc-be74-c83c7f0559d6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:10.618448 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-39b136c0-48ef-4fbc-be74-c83c7f0559d6 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1726 microversion: 2.1 time: 0.223162 Oct 24 13:33:10.619169 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 415/832] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:10 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1726 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:33:10.638548 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-7cc35f77-c8c9-4433-85f7-3d6d73e1d0c0 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.317167 Oct 24 13:33:10.639457 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 418/833] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 24 13:33:10 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:33:10.642707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1aa31733-bc9e-428c-bbee-11e8b2aed8d4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:10.643383 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-1aa31733-bc9e-428c-bbee-11e8b2aed8d4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:10.657992 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1aa31733-bc9e-428c-bbee-11e8b2aed8d4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:10.658493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1aa31733-bc9e-428c-bbee-11e8b2aed8d4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:10.658937 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1aa31733-bc9e-428c-bbee-11e8b2aed8d4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:10.659679 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1aa31733-bc9e-428c-bbee-11e8b2aed8d4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:10.660133 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1aa31733-bc9e-428c-bbee-11e8b2aed8d4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:10.660680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1aa31733-bc9e-428c-bbee-11e8b2aed8d4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:10.749466 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1aa31733-bc9e-428c-bbee-11e8b2aed8d4 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110629 Oct 24 13:33:10.750668 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 416/834] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 24 13:33:10 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:33:10.917152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ff7ff485-08d8-4244-ab69-4740f727b041 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:10.918270 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ff7ff485-08d8-4244-ab69-4740f727b041 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:10.925435 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ff7ff485-08d8-4244-ab69-4740f727b041 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:10.926161 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ff7ff485-08d8-4244-ab69-4740f727b041 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:10.926596 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ff7ff485-08d8-4244-ab69-4740f727b041 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:10.927537 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ff7ff485-08d8-4244-ab69-4740f727b041 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:10.929412 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ff7ff485-08d8-4244-ab69-4740f727b041 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:10.931643 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ff7ff485-08d8-4244-ab69-4740f727b041 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:11.029383 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ff7ff485-08d8-4244-ab69-4740f727b041 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:11.042460 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ff7ff485-08d8-4244-ab69-4740f727b041 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:11.048083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ff7ff485-08d8-4244-ab69-4740f727b041 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:11.053127 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ff7ff485-08d8-4244-ab69-4740f727b041 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1341 microversion: 2.20 time: 0.139814 Oct 24 13:33:11.054893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 419/835] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:33:10 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1341 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:33:12.016593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-f169ea87-6596-4f49-ac9c-5eeb84b83c6e req-1942b13f-0a8d-48bc-a974-05c7e80998a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb595949-cb79-47e4-b760-6e9dfd97b222", "tag": "c2e4dc49-a4c3-4b4e-97ea-3d9c9f960383"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:33:12.031559 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-f169ea87-6596-4f49-ac9c-5eeb84b83c6e req-1942b13f-0a8d-48bc-a974-05c7e80998a2 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:12.032399 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-f169ea87-6596-4f49-ac9c-5eeb84b83c6e req-1942b13f-0a8d-48bc-a974-05c7e80998a2 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:12.032992 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-f169ea87-6596-4f49-ac9c-5eeb84b83c6e req-1942b13f-0a8d-48bc-a974-05c7e80998a2 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:12.047420 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-f169ea87-6596-4f49-ac9c-5eeb84b83c6e req-1942b13f-0a8d-48bc-a974-05c7e80998a2 service nova] Creating event network-changed:c2e4dc49-a4c3-4b4e-97ea-3d9c9f960383 for instance bb595949-cb79-47e4-b760-6e9dfd97b222 on hv-cinder-86249 Oct 24 13:33:12.053968 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-f169ea87-6596-4f49-ac9c-5eeb84b83c6e req-1942b13f-0a8d-48bc-a974-05c7e80998a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123748 Oct 24 13:33:12.055398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 417/836] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:33:12.091766 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c10c9737-c330-4033-aef9-360f9719f9f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:12.093033 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-c10c9737-c330-4033-aef9-360f9719f9f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:12.101954 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c10c9737-c330-4033-aef9-360f9719f9f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:12.102745 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c10c9737-c330-4033-aef9-360f9719f9f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:12.106873 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c10c9737-c330-4033-aef9-360f9719f9f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:12.108196 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c10c9737-c330-4033-aef9-360f9719f9f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:12.108845 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c10c9737-c330-4033-aef9-360f9719f9f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:12.110006 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c10c9737-c330-4033-aef9-360f9719f9f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:12.500403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c10c9737-c330-4033-aef9-360f9719f9f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:12.510589 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c10c9737-c330-4033-aef9-360f9719f9f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:12.512002 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c10c9737-c330-4033-aef9-360f9719f9f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:12.513139 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-c10c9737-c330-4033-aef9-360f9719f9f2 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1406 microversion: 2.20 time: 0.433179 Oct 24 13:33:12.513689 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 420/837] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:33:12 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1406 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:33:13.545237 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-fce71324-46b5-41a2-a90b-84c36c3e54d3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:13.546980 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-fce71324-46b5-41a2-a90b-84c36c3e54d3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:13.560650 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fce71324-46b5-41a2-a90b-84c36c3e54d3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:13.561130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fce71324-46b5-41a2-a90b-84c36c3e54d3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:13.561740 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fce71324-46b5-41a2-a90b-84c36c3e54d3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:13.562450 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fce71324-46b5-41a2-a90b-84c36c3e54d3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:13.563141 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fce71324-46b5-41a2-a90b-84c36c3e54d3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:13.563562 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fce71324-46b5-41a2-a90b-84c36c3e54d3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:13.731709 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fce71324-46b5-41a2-a90b-84c36c3e54d3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:13.740600 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fce71324-46b5-41a2-a90b-84c36c3e54d3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:13.742056 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fce71324-46b5-41a2-a90b-84c36c3e54d3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:13.743166 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-fce71324-46b5-41a2-a90b-84c36c3e54d3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1406 microversion: 2.20 time: 0.205624 Oct 24 13:33:13.743718 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 418/838] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:33:13 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:33:13.802145 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-3283e6eb-e3a5-4ea1-8d48-8162ef5a6e96 req-e65692a6-3e51-4fa4-af50-f56673e9c2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e111014-8ecb-4f6c-865f-a85b64d7cc69", "tag": "13446e7b-9dfe-44f4-b0f9-5884ab770e75"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:33:13.815602 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-3283e6eb-e3a5-4ea1-8d48-8162ef5a6e96 req-e65692a6-3e51-4fa4-af50-f56673e9c2a7 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:13.816847 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-3283e6eb-e3a5-4ea1-8d48-8162ef5a6e96 req-e65692a6-3e51-4fa4-af50-f56673e9c2a7 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:13.817689 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-3283e6eb-e3a5-4ea1-8d48-8162ef5a6e96 req-e65692a6-3e51-4fa4-af50-f56673e9c2a7 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:13.830729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-3283e6eb-e3a5-4ea1-8d48-8162ef5a6e96 req-e65692a6-3e51-4fa4-af50-f56673e9c2a7 service nova] Creating event network-changed:13446e7b-9dfe-44f4-b0f9-5884ab770e75 for instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 on hv-cinder-86249 Oct 24 13:33:13.836919 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-3283e6eb-e3a5-4ea1-8d48-8162ef5a6e96 req-e65692a6-3e51-4fa4-af50-f56673e9c2a7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038257 Oct 24 13:33:13.838108 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 421/839] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:33:14.072678 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-086cf502-ced7-42a2-8085-9b6cf9e35bb0 req-9fde13c0-16c5-4092-9759-b78914e62747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb595949-cb79-47e4-b760-6e9dfd97b222", "tag": "c2e4dc49-a4c3-4b4e-97ea-3d9c9f960383"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:33:14.088039 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-086cf502-ced7-42a2-8085-9b6cf9e35bb0 req-9fde13c0-16c5-4092-9759-b78914e62747 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:14.089485 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-086cf502-ced7-42a2-8085-9b6cf9e35bb0 req-9fde13c0-16c5-4092-9759-b78914e62747 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:14.090149 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-086cf502-ced7-42a2-8085-9b6cf9e35bb0 req-9fde13c0-16c5-4092-9759-b78914e62747 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:14.109156 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-086cf502-ced7-42a2-8085-9b6cf9e35bb0 req-9fde13c0-16c5-4092-9759-b78914e62747 service nova] Creating event network-changed:c2e4dc49-a4c3-4b4e-97ea-3d9c9f960383 for instance bb595949-cb79-47e4-b760-6e9dfd97b222 on hv-cinder-86249 Oct 24 13:33:14.123300 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-086cf502-ced7-42a2-8085-9b6cf9e35bb0 req-9fde13c0-16c5-4092-9759-b78914e62747 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050515 Oct 24 13:33:14.123300 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 419/840] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:33:14.769809 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-622de95c-852d-48c4-8e9d-b0850e7b7fb9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:14.770801 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-622de95c-852d-48c4-8e9d-b0850e7b7fb9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:14.777774 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-622de95c-852d-48c4-8e9d-b0850e7b7fb9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:14.778324 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-622de95c-852d-48c4-8e9d-b0850e7b7fb9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:14.778959 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-622de95c-852d-48c4-8e9d-b0850e7b7fb9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:14.779841 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-622de95c-852d-48c4-8e9d-b0850e7b7fb9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:14.780950 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-622de95c-852d-48c4-8e9d-b0850e7b7fb9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:14.796663 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-622de95c-852d-48c4-8e9d-b0850e7b7fb9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:15.121876 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-622de95c-852d-48c4-8e9d-b0850e7b7fb9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:15.130030 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-622de95c-852d-48c4-8e9d-b0850e7b7fb9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:15.131472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-622de95c-852d-48c4-8e9d-b0850e7b7fb9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:15.132684 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-622de95c-852d-48c4-8e9d-b0850e7b7fb9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1406 microversion: 2.20 time: 0.368123 Oct 24 13:33:15.133238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 422/841] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:33:14 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1406 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:33:16.159027 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8019d501-a932-4489-8721-372bdcbb8e32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:16.159713 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8019d501-a932-4489-8721-372bdcbb8e32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:16.165905 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8019d501-a932-4489-8721-372bdcbb8e32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:16.166390 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8019d501-a932-4489-8721-372bdcbb8e32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:16.172527 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8019d501-a932-4489-8721-372bdcbb8e32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:16.172527 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8019d501-a932-4489-8721-372bdcbb8e32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:16.172527 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8019d501-a932-4489-8721-372bdcbb8e32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:16.172527 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8019d501-a932-4489-8721-372bdcbb8e32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:16.302845 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8019d501-a932-4489-8721-372bdcbb8e32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:16.310804 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8019d501-a932-4489-8721-372bdcbb8e32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:16.312408 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8019d501-a932-4489-8721-372bdcbb8e32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:16.313508 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8019d501-a932-4489-8721-372bdcbb8e32 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1406 microversion: 2.20 time: 0.159417 Oct 24 13:33:16.314063 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 420/842] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:33:16 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:33:17.343264 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-228fa62b-7480-4a2d-aed3-103532b3538f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:17.344519 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-228fa62b-7480-4a2d-aed3-103532b3538f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:17.347099 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=2 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:17.352420 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-228fa62b-7480-4a2d-aed3-103532b3538f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:17.352897 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-228fa62b-7480-4a2d-aed3-103532b3538f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:17.353323 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-228fa62b-7480-4a2d-aed3-103532b3538f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:17.354012 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-228fa62b-7480-4a2d-aed3-103532b3538f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:17.354459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-228fa62b-7480-4a2d-aed3-103532b3538f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:17.354881 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-228fa62b-7480-4a2d-aed3-103532b3538f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:17.487550 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-228fa62b-7480-4a2d-aed3-103532b3538f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:17.496213 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-228fa62b-7480-4a2d-aed3-103532b3538f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:17.497670 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-228fa62b-7480-4a2d-aed3-103532b3538f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:17.498804 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-228fa62b-7480-4a2d-aed3-103532b3538f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1406 microversion: 2.20 time: 0.159501 Oct 24 13:33:17.499370 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 423/843] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:33:17 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:33:18.523577 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-03217bee-838c-4d98-b247-137333ea08de tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:18.524233 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-03217bee-838c-4d98-b247-137333ea08de tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:18.526744 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=6 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:18.531674 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-03217bee-838c-4d98-b247-137333ea08de tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:18.532155 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-03217bee-838c-4d98-b247-137333ea08de tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:18.532722 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-03217bee-838c-4d98-b247-137333ea08de tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:18.539280 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-03217bee-838c-4d98-b247-137333ea08de tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:18.539280 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-03217bee-838c-4d98-b247-137333ea08de tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:18.539280 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-03217bee-838c-4d98-b247-137333ea08de tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:18.666698 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-03217bee-838c-4d98-b247-137333ea08de tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:18.675610 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-03217bee-838c-4d98-b247-137333ea08de tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:18.677082 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-03217bee-838c-4d98-b247-137333ea08de tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:18.678208 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-03217bee-838c-4d98-b247-137333ea08de tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1406 microversion: 2.20 time: 0.159152 Oct 24 13:33:18.678763 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 421/844] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:33:18 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:33:19.703100 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-786831b7-4ce2-45d2-aebd-d26471d58c4f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:19.703704 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-786831b7-4ce2-45d2-aebd-d26471d58c4f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:19.712619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-786831b7-4ce2-45d2-aebd-d26471d58c4f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:19.713398 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-786831b7-4ce2-45d2-aebd-d26471d58c4f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:19.714015 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-786831b7-4ce2-45d2-aebd-d26471d58c4f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:19.714864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-786831b7-4ce2-45d2-aebd-d26471d58c4f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:19.715317 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-786831b7-4ce2-45d2-aebd-d26471d58c4f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:19.715733 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-786831b7-4ce2-45d2-aebd-d26471d58c4f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:19.765916 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-f8f4da4b-3ad6-405d-a54f-0105e910ae26 req-e6a606b2-c547-46ae-a0f1-06fba30bd996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e111014-8ecb-4f6c-865f-a85b64d7cc69", "name": "network-vif-plugged", "status": "completed", "tag": "13446e7b-9dfe-44f4-b0f9-5884ab770e75"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:33:19.781061 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-f8f4da4b-3ad6-405d-a54f-0105e910ae26 req-e6a606b2-c547-46ae-a0f1-06fba30bd996 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:19.781791 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-f8f4da4b-3ad6-405d-a54f-0105e910ae26 req-e6a606b2-c547-46ae-a0f1-06fba30bd996 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:19.782303 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-f8f4da4b-3ad6-405d-a54f-0105e910ae26 req-e6a606b2-c547-46ae-a0f1-06fba30bd996 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:19.794188 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-f8f4da4b-3ad6-405d-a54f-0105e910ae26 req-e6a606b2-c547-46ae-a0f1-06fba30bd996 service nova] Creating event network-vif-plugged:13446e7b-9dfe-44f4-b0f9-5884ab770e75 for instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 on hv-cinder-86249 Oct 24 13:33:19.799168 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-f8f4da4b-3ad6-405d-a54f-0105e910ae26 req-e6a606b2-c547-46ae-a0f1-06fba30bd996 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037132 Oct 24 13:33:19.799842 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 422/845] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:33:19.852084 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-786831b7-4ce2-45d2-aebd-d26471d58c4f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:19.862271 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-786831b7-4ce2-45d2-aebd-d26471d58c4f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:19.863829 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-786831b7-4ce2-45d2-aebd-d26471d58c4f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:19.865111 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-786831b7-4ce2-45d2-aebd-d26471d58c4f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1406 microversion: 2.20 time: 0.166184 Oct 24 13:33:19.865929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 424/846] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:33:19 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:33:20.892564 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-40876864-ef09-492f-8fe9-a9847f38625b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:20.893207 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-40876864-ef09-492f-8fe9-a9847f38625b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:20.899815 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-40876864-ef09-492f-8fe9-a9847f38625b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:20.900320 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-40876864-ef09-492f-8fe9-a9847f38625b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:20.900752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-40876864-ef09-492f-8fe9-a9847f38625b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:20.901432 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-40876864-ef09-492f-8fe9-a9847f38625b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:20.901879 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-40876864-ef09-492f-8fe9-a9847f38625b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:20.902295 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-40876864-ef09-492f-8fe9-a9847f38625b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:21.032486 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-40876864-ef09-492f-8fe9-a9847f38625b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:21.041675 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-40876864-ef09-492f-8fe9-a9847f38625b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:21.047960 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-40876864-ef09-492f-8fe9-a9847f38625b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:21.047960 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-40876864-ef09-492f-8fe9-a9847f38625b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1406 microversion: 2.20 time: 0.156613 Oct 24 13:33:21.047960 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 423/847] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:33:20 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:33:22.069438 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-4362b5b5-98a1-45be-b84b-adebaf3901e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:22.070048 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-4362b5b5-98a1-45be-b84b-adebaf3901e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:22.071937 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=12 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:22.077304 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4362b5b5-98a1-45be-b84b-adebaf3901e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:22.077786 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4362b5b5-98a1-45be-b84b-adebaf3901e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:22.078216 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4362b5b5-98a1-45be-b84b-adebaf3901e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:22.078912 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4362b5b5-98a1-45be-b84b-adebaf3901e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:22.079356 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4362b5b5-98a1-45be-b84b-adebaf3901e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:22.079799 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4362b5b5-98a1-45be-b84b-adebaf3901e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:22.214362 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-4362b5b5-98a1-45be-b84b-adebaf3901e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:22.222394 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-4362b5b5-98a1-45be-b84b-adebaf3901e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:22.223821 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-4362b5b5-98a1-45be-b84b-adebaf3901e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:22.224945 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-4362b5b5-98a1-45be-b84b-adebaf3901e1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1406 microversion: 2.20 time: 0.160099 Oct 24 13:33:22.225508 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 425/848] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:33:22 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:33:23.252100 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e1cb6f8f-feca-46a9-82b2-dbba27350431 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:23.252738 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e1cb6f8f-feca-46a9-82b2-dbba27350431 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:23.259397 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e1cb6f8f-feca-46a9-82b2-dbba27350431 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:23.259873 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e1cb6f8f-feca-46a9-82b2-dbba27350431 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:23.260331 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e1cb6f8f-feca-46a9-82b2-dbba27350431 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:23.261015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e1cb6f8f-feca-46a9-82b2-dbba27350431 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:23.261464 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e1cb6f8f-feca-46a9-82b2-dbba27350431 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:23.261882 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e1cb6f8f-feca-46a9-82b2-dbba27350431 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:23.394171 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e1cb6f8f-feca-46a9-82b2-dbba27350431 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:23.402387 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e1cb6f8f-feca-46a9-82b2-dbba27350431 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:23.403940 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e1cb6f8f-feca-46a9-82b2-dbba27350431 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:23.405289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e1cb6f8f-feca-46a9-82b2-dbba27350431 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1598 microversion: 2.20 time: 0.157099 Oct 24 13:33:23.406027 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 424/849] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:33:23 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:33:23.431303 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-1c25f235-7e31-4bd6-a95f-d59525e895f9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:23.431841 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-1c25f235-7e31-4bd6-a95f-d59525e895f9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:23.438252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1c25f235-7e31-4bd6-a95f-d59525e895f9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:23.438739 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1c25f235-7e31-4bd6-a95f-d59525e895f9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:23.439170 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1c25f235-7e31-4bd6-a95f-d59525e895f9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:23.439856 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1c25f235-7e31-4bd6-a95f-d59525e895f9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:23.440328 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1c25f235-7e31-4bd6-a95f-d59525e895f9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:23.440753 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1c25f235-7e31-4bd6-a95f-d59525e895f9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:23.519993 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-1c25f235-7e31-4bd6-a95f-d59525e895f9 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092529 Oct 24 13:33:23.520651 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 426/850] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Oct 24 13:33:23 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:33:24.731145 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-eff01a13-552a-4e16-aee8-e4454704dbdc req-c9c87918-f6c8-4855-807c-f05baba3c93a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e111014-8ecb-4f6c-865f-a85b64d7cc69", "tag": "13446e7b-9dfe-44f4-b0f9-5884ab770e75"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:33:24.741029 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-eff01a13-552a-4e16-aee8-e4454704dbdc req-c9c87918-f6c8-4855-807c-f05baba3c93a service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:24.741574 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-eff01a13-552a-4e16-aee8-e4454704dbdc req-c9c87918-f6c8-4855-807c-f05baba3c93a service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:24.742065 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-eff01a13-552a-4e16-aee8-e4454704dbdc req-c9c87918-f6c8-4855-807c-f05baba3c93a service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:24.753082 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-eff01a13-552a-4e16-aee8-e4454704dbdc req-c9c87918-f6c8-4855-807c-f05baba3c93a service nova] Creating event network-changed:13446e7b-9dfe-44f4-b0f9-5884ab770e75 for instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 on hv-cinder-86249 Oct 24 13:33:24.757913 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-eff01a13-552a-4e16-aee8-e4454704dbdc req-c9c87918-f6c8-4855-807c-f05baba3c93a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030701 Oct 24 13:33:24.760194 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 425/851] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:33:36.777785 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:36.778611 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=64 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:36.782794 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e5103bf2-8277-48b2-a002-9703d3bc8025 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:36.784966 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e5103bf2-8277-48b2-a002-9703d3bc8025 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:36.791286 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e5103bf2-8277-48b2-a002-9703d3bc8025 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:36.791757 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e5103bf2-8277-48b2-a002-9703d3bc8025 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:36.792182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e5103bf2-8277-48b2-a002-9703d3bc8025 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:36.792883 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e5103bf2-8277-48b2-a002-9703d3bc8025 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:36.793358 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e5103bf2-8277-48b2-a002-9703d3bc8025 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:36.793773 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e5103bf2-8277-48b2-a002-9703d3bc8025 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:36.823044 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e5103bf2-8277-48b2-a002-9703d3bc8025 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046551 Oct 24 13:33:36.823517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 427/852] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 24 13:33:36 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:33:36.884685 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=29 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:36.885449 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:36.889929 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-537c6aa6-c414-4613-82e8-a3a088b68d66 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:36.890505 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-537c6aa6-c414-4613-82e8-a3a088b68d66 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:36.896997 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-537c6aa6-c414-4613-82e8-a3a088b68d66 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:36.897475 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-537c6aa6-c414-4613-82e8-a3a088b68d66 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:36.897897 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-537c6aa6-c414-4613-82e8-a3a088b68d66 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:36.898578 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-537c6aa6-c414-4613-82e8-a3a088b68d66 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:36.899031 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-537c6aa6-c414-4613-82e8-a3a088b68d66 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:36.899446 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-537c6aa6-c414-4613-82e8-a3a088b68d66 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:36.924776 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-537c6aa6-c414-4613-82e8-a3a088b68d66 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Going to try to terminate instance {{(pid=119146) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:33:37.177852 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-537c6aa6-c414-4613-82e8-a3a088b68d66 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 204 len: 0 microversion: 2.1 time: 0.294402 Oct 24 13:33:37.178442 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 426/853] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:33:36 2022] DELETE /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:33:37.187334 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-bc5a20dd-233c-4d97-bc43-70d8da941b75 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:37.189725 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-bc5a20dd-233c-4d97-bc43-70d8da941b75 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:37.195665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bc5a20dd-233c-4d97-bc43-70d8da941b75 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:37.196136 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bc5a20dd-233c-4d97-bc43-70d8da941b75 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:37.196591 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bc5a20dd-233c-4d97-bc43-70d8da941b75 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:37.197263 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bc5a20dd-233c-4d97-bc43-70d8da941b75 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:37.197809 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bc5a20dd-233c-4d97-bc43-70d8da941b75 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:37.198207 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bc5a20dd-233c-4d97-bc43-70d8da941b75 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:37.325185 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-bc5a20dd-233c-4d97-bc43-70d8da941b75 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:37.333208 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-bc5a20dd-233c-4d97-bc43-70d8da941b75 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1674 microversion: 2.1 time: 0.150512 Oct 24 13:33:37.334006 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 428/854] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:37 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:37.993495 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e1b46c95-3fe2-4673-9f9c-50056b6c90e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1375420671", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-615995550", "security_groups": [{"name": "tempest-secgroup-smoke-45723429"}], "networks": [{"uuid": "67459548-be71-4331-875c-7f5bcf34433e"}], "block_device_mapping_v2": [{"uuid": "7b845838-d9c2-40be-af55-08c9c6852ece", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:33:38.107055 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.network.neutron [None req-e1b46c95-3fe2-4673-9f9c-50056b6c90e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] validate_networks() for [('67459548-be71-4331-875c-7f5bcf34433e', None, None, None, None, None)] {{(pid=119146) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:33:38.357572 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-94f75df8-4db2-4d20-b0e2-1fcf66ba1b28 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:38.358787 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-94f75df8-4db2-4d20-b0e2-1fcf66ba1b28 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:38.365877 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-94f75df8-4db2-4d20-b0e2-1fcf66ba1b28 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:38.366749 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-94f75df8-4db2-4d20-b0e2-1fcf66ba1b28 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:38.367177 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-94f75df8-4db2-4d20-b0e2-1fcf66ba1b28 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:38.367867 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-94f75df8-4db2-4d20-b0e2-1fcf66ba1b28 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:38.368730 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-94f75df8-4db2-4d20-b0e2-1fcf66ba1b28 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:38.368730 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-94f75df8-4db2-4d20-b0e2-1fcf66ba1b28 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:38.501148 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-94f75df8-4db2-4d20-b0e2-1fcf66ba1b28 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:38.509902 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-94f75df8-4db2-4d20-b0e2-1fcf66ba1b28 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1674 microversion: 2.1 time: 0.156441 Oct 24 13:33:38.524298 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 429/855] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:38 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:38.682083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-e1b46c95-3fe2-4673-9f9c-50056b6c90e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Flavor limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:33:38.682497 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-e1b46c95-3fe2-4673-9f9c-50056b6c90e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Image limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:33:38.682957 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-e1b46c95-3fe2-4673-9f9c-50056b6c90e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Flavor pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:33:38.683681 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-e1b46c95-3fe2-4673-9f9c-50056b6c90e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Image pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:33:38.684091 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-e1b46c95-3fe2-4673-9f9c-50056b6c90e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:33:38.693730 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e1b46c95-3fe2-4673-9f9c-50056b6c90e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:38.694212 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e1b46c95-3fe2-4673-9f9c-50056b6c90e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:38.694647 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e1b46c95-3fe2-4673-9f9c-50056b6c90e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:38.695376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e1b46c95-3fe2-4673-9f9c-50056b6c90e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:38.695830 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e1b46c95-3fe2-4673-9f9c-50056b6c90e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:38.696293 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e1b46c95-3fe2-4673-9f9c-50056b6c90e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:38.713214 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-e1b46c95-3fe2-4673-9f9c-50056b6c90e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Getting quotas for project a946788afc074f079618f1a848ec0f8c. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:33:38.717192 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-e1b46c95-3fe2-4673-9f9c-50056b6c90e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Getting quotas for user 33af9a4e3c29426b90dfd5abebde5ed4 and project a946788afc074f079618f1a848ec0f8c. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:33:38.774201 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e1b46c95-3fe2-4673-9f9c-50056b6c90e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Going to run 1 instances... {{(pid=119146) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:33:38.776533 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e1b46c95-3fe2-4673-9f9c-50056b6c90e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b845838-d9c2-40be-af55-08c9c6852ece',volume_size=None,volume_type=None)] {{(pid=119146) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:33:39.149437 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e1b46c95-3fe2-4673-9f9c-50056b6c90e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [e8529188-15fa-4df5-95bd-f939e24ad16f] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 13:33:39.488438 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-f7fb30b2-eae5-4d09-ac0b-eced9994f5bf req-9b1cf726-5887-45dd-aef9-88ed9555034b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a568b3c6-b364-45d0-a9fa-2bdbde43ccaa", "name": "network-vif-deleted", "tag": "bdec5a38-0967-442c-8d70-b3f416f6105f"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:33:39.497975 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-f7fb30b2-eae5-4d09-ac0b-eced9994f5bf req-9b1cf726-5887-45dd-aef9-88ed9555034b service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:39.498441 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-f7fb30b2-eae5-4d09-ac0b-eced9994f5bf req-9b1cf726-5887-45dd-aef9-88ed9555034b service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:39.498886 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-f7fb30b2-eae5-4d09-ac0b-eced9994f5bf req-9b1cf726-5887-45dd-aef9-88ed9555034b service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:39.509885 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-f7fb30b2-eae5-4d09-ac0b-eced9994f5bf req-9b1cf726-5887-45dd-aef9-88ed9555034b service nova] Creating event network-vif-deleted:bdec5a38-0967-442c-8d70-b3f416f6105f for instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa on hv-cinder-86249 Oct 24 13:33:39.515177 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-f7fb30b2-eae5-4d09-ac0b-eced9994f5bf req-9b1cf726-5887-45dd-aef9-88ed9555034b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030492 Oct 24 13:33:39.516132 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 430/856] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:33:39.534360 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-097e5ca2-bf9d-4c36-9a1a-4d73578d673a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:39.548460 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-097e5ca2-bf9d-4c36-9a1a-4d73578d673a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:39.548460 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-097e5ca2-bf9d-4c36-9a1a-4d73578d673a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:39.548460 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-097e5ca2-bf9d-4c36-9a1a-4d73578d673a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:39.548460 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-097e5ca2-bf9d-4c36-9a1a-4d73578d673a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:39.549540 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-097e5ca2-bf9d-4c36-9a1a-4d73578d673a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:39.549540 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-097e5ca2-bf9d-4c36-9a1a-4d73578d673a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:39.549540 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-097e5ca2-bf9d-4c36-9a1a-4d73578d673a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:39.622345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-097e5ca2-bf9d-4c36-9a1a-4d73578d673a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:39.631140 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-097e5ca2-bf9d-4c36-9a1a-4d73578d673a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 200 len: 1606 microversion: 2.1 time: 0.100076 Oct 24 13:33:39.631983 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 431/857] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:39 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 1606 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:40.157265 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO oslo.messaging._drivers.impl_rabbit [None req-e1b46c95-3fe2-4673-9f9c-50056b6c90e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [e8529188-15fa-4df5-95bd-f939e24ad16f] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 34054. Oct 24 13:33:40.162599 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e1b46c95-3fe2-4673-9f9c-50056b6c90e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.173566 Oct 24 13:33:40.163332 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 427/858] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 24 13:33:37 2022] POST /compute/v2.1/servers => generated 404 bytes in 2175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:33:40.174232 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ae40d8b0-914d-4a94-a2f9-9c63f9d0d5df tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:40.174851 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ae40d8b0-914d-4a94-a2f9-9c63f9d0d5df tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:40.230622 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ae40d8b0-914d-4a94-a2f9-9c63f9d0d5df tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:40.237530 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ae40d8b0-914d-4a94-a2f9-9c63f9d0d5df tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1088 microversion: 2.1 time: 0.067130 Oct 24 13:33:40.238095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 432/859] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:40 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:40.654568 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c65d675b-de4f-41a9-b0cc-a350d762ff99 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:40.655220 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c65d675b-de4f-41a9-b0cc-a350d762ff99 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:40.661890 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c65d675b-de4f-41a9-b0cc-a350d762ff99 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:40.668458 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c65d675b-de4f-41a9-b0cc-a350d762ff99 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:40.668458 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c65d675b-de4f-41a9-b0cc-a350d762ff99 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:40.668458 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c65d675b-de4f-41a9-b0cc-a350d762ff99 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:40.668458 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c65d675b-de4f-41a9-b0cc-a350d762ff99 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:40.668852 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c65d675b-de4f-41a9-b0cc-a350d762ff99 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:40.678188 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-c65d675b-de4f-41a9-b0cc-a350d762ff99 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] HTTP exception thrown: Instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa could not be found. Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c65d675b-de4f-41a9-b0cc-a350d762ff99 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Request method failure captured: Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa HTTP/1.1 Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpJKlKQjYs1MmspmjNUNKBpfayBoamaJVHfF9IBf4UVrmv8R451ig0EBZGkiw1R5T9MDBDRdVCcuBAwSC8u0xJLyxwFDc7FlNVXURIj5NKNfyHSmjkEh3wDsDA6nnyqxx0_yhFQqucG_16aMkjN5TyPzXeWFLlNMREn-TrBii6In0Do Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: e3faf7ad1fea4ab8b08c98a10491ec11 Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-AttachVolumeTestJSON-323460550 Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:33:40.679806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:33:40.681498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e3faf7ad1fea4ab8b08c98a10491ec11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3faf7ad1fea4ab8b08c98a10491ec11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3faf7ad1fea4ab8b08c98a10491ec11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e3faf7ad1fea4ab8b08c98a10491ec11"}]}] Oct 24 13:33:40.681498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-AttachVolumeTestJSON-323460550 Oct 24 13:33:40.681498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: e3faf7ad1fea4ab8b08c98a10491ec11 Oct 24 13:33:40.681498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-AttachVolumeTestJSON-323460550 Oct 24 13:33:40.681498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-AttachVolumeTestJSON-323460550-project Oct 24 13:33:40.681498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:33:40.681498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:33:40.681498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: e0dd5e32e4a642c8ac9e44310e0a6a5b Oct 24 13:33:40.681498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-AttachVolumeTestJSON-323460550-project Oct 24 13:33:40.681498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:33:40.681498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa could not be found. Oct 24 13:33:40.681498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': 'a568b3c6-b364-45d0-a9fa-2bdbde43ccaa'} Oct 24 13:33:40.682404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:33:40.682404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:33:40.682404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:33:40.682404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:33:40.682404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:33:40.682404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:33:40.682404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:33:40.682404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:33:40.682404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:33:40.682404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:33:40.682404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa could not be found. Oct 24 13:33:40.682404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:33:40.682404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:33:40.682404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:33:40.682404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:33:40.682404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:33:40.682404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:33:40.682404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:33:40.682404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:33:40.682404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:33:40.683970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:33:40.683970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:33:40.683970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:33:40.683970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:33:40.683970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:33:40.683970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:33:40.683970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:33:40.683970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa could not be found. Oct 24 13:33:40.683970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:33:40.683970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:33:40.683970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:33:40.683970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:33:40.683970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:33:40.683970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:33:40.683970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:33:40.683970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:33:40.683970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa could not be found. Oct 24 13:33:40.683970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:33:40.685529 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c65d675b-de4f-41a9-b0cc-a350d762ff99 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Returning 404 to user: Instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:33:40.685529 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c65d675b-de4f-41a9-b0cc-a350d762ff99 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 404 len: 111 microversion: 2.1 time: 0.030636 Oct 24 13:33:40.685529 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 428/860] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:40 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:33:40.690057 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f4ef1653-9e17-45d3-9e67-942649664f54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '.version_select at 0x7f17a81da9d0>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:40.755070 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f4ef1653-9e17-45d3-9e67-942649664f54 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1331417750" status: 202 len: 0 microversion: 2.1 time: 0.068749 Oct 24 13:33:40.755619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 433/861] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 24 13:33:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1331417750 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:33:41.260369 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3ce7ddea-016b-474f-b3dc-1311794ee785 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:41.260986 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-3ce7ddea-016b-474f-b3dc-1311794ee785 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:41.337833 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3ce7ddea-016b-474f-b3dc-1311794ee785 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:41.344684 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3ce7ddea-016b-474f-b3dc-1311794ee785 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1088 microversion: 2.1 time: 0.088130 Oct 24 13:33:41.345252 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 429/862] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:41 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1088 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:41.505954 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-57290f42-000f-49a3-ac0e-3ce36f94f721 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Action: 'create', calling method: .version_select at 0x7f17a8116700>, body: {"keypair": {"name": "tempest-keypair-1262094304", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEldLhjGF7PthV9NAcWyB8XSynsupIYD67rxPso96lgetZ3k9ku5wxNvwa1yzR7p0m4VvZgyaRq6oyqgCVcp87iuotSCVEm6eMSGE176eyCnBA8tbwezfdprA1wXJ8TyhA=="}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:33:41.521943 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-57290f42-000f-49a3-ac0e-3ce36f94f721 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Getting quotas for project e3faf7ad1fea4ab8b08c98a10491ec11. Resources: {'key_pairs'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:33:41.525734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-57290f42-000f-49a3-ac0e-3ce36f94f721 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Getting quotas for user e0dd5e32e4a642c8ac9e44310e0a6a5b and project e3faf7ad1fea4ab8b08c98a10491ec11. Resources: {'key_pairs'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:33:41.584650 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-57290f42-000f-49a3-ac0e-3ce36f94f721 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.083186 Oct 24 13:33:41.585309 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 434/863] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 24 13:33:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:33:42.367510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-80a9dd42-a3cb-4fe6-934c-d8cc81d57551 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:42.368042 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-80a9dd42-a3cb-4fe6-934c-d8cc81d57551 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:42.425329 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-80a9dd42-a3cb-4fe6-934c-d8cc81d57551 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:42.433106 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-80a9dd42-a3cb-4fe6-934c-d8cc81d57551 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1088 microversion: 2.1 time: 0.069505 Oct 24 13:33:42.433701 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 430/864] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:42 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:43.456855 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a39ed7d2-9250-4c17-84d2-8b6cf2c4a63a tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:43.457455 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a39ed7d2-9250-4c17-84d2-8b6cf2c4a63a tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:43.511788 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a39ed7d2-9250-4c17-84d2-8b6cf2c4a63a tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:43.518741 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a39ed7d2-9250-4c17-84d2-8b6cf2c4a63a tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1088 microversion: 2.1 time: 0.065779 Oct 24 13:33:43.519257 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 435/865] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:43 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:43.619361 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-48844cf3-90dd-46dc-a512-58c288c37cbe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-993951996", "imageRef": "1a874490-179e-412c-895e-52b16935c04c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "143f8287-8fb4-4393-ae4f-ca898c17799f"}], "security_groups": [{"name": "tempest-securitygroup--572613168"}], "key_name": "tempest-keypair-1262094304", "user_data": "}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:33:43.721253 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.network.neutron [None req-48844cf3-90dd-46dc-a512-58c288c37cbe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] validate_networks() for [('143f8287-8fb4-4393-ae4f-ca898c17799f', None, None, None, None, None)] {{(pid=119146) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:33:44.092633 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-48844cf3-90dd-46dc-a512-58c288c37cbe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Flavor limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:33:44.093055 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-48844cf3-90dd-46dc-a512-58c288c37cbe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Image limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:33:44.093529 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-48844cf3-90dd-46dc-a512-58c288c37cbe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Flavor pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:33:44.093938 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-48844cf3-90dd-46dc-a512-58c288c37cbe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Image pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:33:44.094348 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-48844cf3-90dd-46dc-a512-58c288c37cbe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:33:44.103309 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-48844cf3-90dd-46dc-a512-58c288c37cbe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:44.103792 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-48844cf3-90dd-46dc-a512-58c288c37cbe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:44.104225 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-48844cf3-90dd-46dc-a512-58c288c37cbe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:44.104980 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-48844cf3-90dd-46dc-a512-58c288c37cbe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:44.105435 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-48844cf3-90dd-46dc-a512-58c288c37cbe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:44.105859 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-48844cf3-90dd-46dc-a512-58c288c37cbe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:44.123192 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-48844cf3-90dd-46dc-a512-58c288c37cbe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Getting quotas for project e3faf7ad1fea4ab8b08c98a10491ec11. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:33:44.127078 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-48844cf3-90dd-46dc-a512-58c288c37cbe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Getting quotas for user e0dd5e32e4a642c8ac9e44310e0a6a5b and project e3faf7ad1fea4ab8b08c98a10491ec11. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:33:44.138541 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-48844cf3-90dd-46dc-a512-58c288c37cbe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Going to run 1 instances... {{(pid=119146) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:33:44.140719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-48844cf3-90dd-46dc-a512-58c288c37cbe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a874490-179e-412c-895e-52b16935c04c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119146) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:33:44.272332 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-48844cf3-90dd-46dc-a512-58c288c37cbe tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.656796 Oct 24 13:33:44.273577 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 431/866] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 24 13:33:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:33:44.283870 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b914ca9a-015e-42b1-968a-d297dc26f9d9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:44.285022 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b914ca9a-015e-42b1-968a-d297dc26f9d9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:44.338837 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b914ca9a-015e-42b1-968a-d297dc26f9d9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:44.345710 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b914ca9a-015e-42b1-968a-d297dc26f9d9 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 200 len: 1237 microversion: 2.1 time: 0.065611 Oct 24 13:33:44.356427 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 436/867] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:44 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 1237 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:44.542296 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1192dd4a-cceb-42fb-87d6-02b5bf073dee tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:44.542918 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-1192dd4a-cceb-42fb-87d6-02b5bf073dee tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:44.549160 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1192dd4a-cceb-42fb-87d6-02b5bf073dee tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:44.549650 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1192dd4a-cceb-42fb-87d6-02b5bf073dee tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:44.550082 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1192dd4a-cceb-42fb-87d6-02b5bf073dee tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:44.550773 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1192dd4a-cceb-42fb-87d6-02b5bf073dee tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:44.551224 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1192dd4a-cceb-42fb-87d6-02b5bf073dee tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:44.551645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1192dd4a-cceb-42fb-87d6-02b5bf073dee tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:44.612958 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1192dd4a-cceb-42fb-87d6-02b5bf073dee tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:44.623015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1192dd4a-cceb-42fb-87d6-02b5bf073dee tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1138 microversion: 2.1 time: 0.084320 Oct 24 13:33:44.623547 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 432/868] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:44 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:45.368666 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-5ec3e831-737a-442e-81d6-54eac626dbde tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:45.369208 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-5ec3e831-737a-442e-81d6-54eac626dbde tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:45.375955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5ec3e831-737a-442e-81d6-54eac626dbde tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:45.376476 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5ec3e831-737a-442e-81d6-54eac626dbde tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:45.376908 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5ec3e831-737a-442e-81d6-54eac626dbde tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:45.377599 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5ec3e831-737a-442e-81d6-54eac626dbde tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:45.378029 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5ec3e831-737a-442e-81d6-54eac626dbde tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:45.378445 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5ec3e831-737a-442e-81d6-54eac626dbde tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:45.441250 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-5ec3e831-737a-442e-81d6-54eac626dbde tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:45.449917 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-5ec3e831-737a-442e-81d6-54eac626dbde tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 200 len: 1233 microversion: 2.1 time: 0.085266 Oct 24 13:33:45.450747 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 437/869] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:45 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 1233 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:45.645804 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-842d972f-fd44-4f9d-bf0f-daf4a90e4cd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:45.646417 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-842d972f-fd44-4f9d-bf0f-daf4a90e4cd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:45.652408 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-842d972f-fd44-4f9d-bf0f-daf4a90e4cd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:45.653574 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-842d972f-fd44-4f9d-bf0f-daf4a90e4cd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:45.653574 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-842d972f-fd44-4f9d-bf0f-daf4a90e4cd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:45.654041 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-842d972f-fd44-4f9d-bf0f-daf4a90e4cd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:45.654482 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-842d972f-fd44-4f9d-bf0f-daf4a90e4cd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:45.654890 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-842d972f-fd44-4f9d-bf0f-daf4a90e4cd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:45.720387 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-842d972f-fd44-4f9d-bf0f-daf4a90e4cd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:45.729668 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-842d972f-fd44-4f9d-bf0f-daf4a90e4cd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1130 microversion: 2.1 time: 0.088004 Oct 24 13:33:45.730366 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 438/870] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:45 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1130 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:33:45.735637 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-0cfaed72-7bcd-4790-a12b-aacfc5a14b12 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-260171931"}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:33:45.736165 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-0cfaed72-7bcd-4790-a12b-aacfc5a14b12 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:45.742702 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0cfaed72-7bcd-4790-a12b-aacfc5a14b12 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:45.743179 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0cfaed72-7bcd-4790-a12b-aacfc5a14b12 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:45.743601 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0cfaed72-7bcd-4790-a12b-aacfc5a14b12 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:45.744298 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0cfaed72-7bcd-4790-a12b-aacfc5a14b12 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:45.744749 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0cfaed72-7bcd-4790-a12b-aacfc5a14b12 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:45.745162 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0cfaed72-7bcd-4790-a12b-aacfc5a14b12 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:45.873054 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.network.security_group_api [None req-0cfaed72-7bcd-4790-a12b-aacfc5a14b12 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Removing security group 82ad26cd-2938-472e-8225-5d5c9ce839ee from port 600465f3-a863-40a8-8e98-8ea8cd65d5a3 Oct 24 13:33:46.252583 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-0cfaed72-7bcd-4790-a12b-aacfc5a14b12 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "POST /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac/action" status: 202 len: 0 microversion: 2.1 time: 0.656306 Oct 24 13:33:46.253945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 433/871] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 24 13:33:45 2022] POST /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac/action => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:33:46.271216 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-aab86aca-7969-4fd6-8960-2ae32d9c8b8d req-f45de98f-c431-46fd-86c7-2add481c6ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47783c4e-2d71-46f8-a964-e268979915ac", "tag": "600465f3-a863-40a8-8e98-8ea8cd65d5a3"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:33:46.283161 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-aab86aca-7969-4fd6-8960-2ae32d9c8b8d req-f45de98f-c431-46fd-86c7-2add481c6ff0 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:46.283161 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-aab86aca-7969-4fd6-8960-2ae32d9c8b8d req-f45de98f-c431-46fd-86c7-2add481c6ff0 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:46.283817 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-aab86aca-7969-4fd6-8960-2ae32d9c8b8d req-f45de98f-c431-46fd-86c7-2add481c6ff0 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:46.297219 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-aab86aca-7969-4fd6-8960-2ae32d9c8b8d req-f45de98f-c431-46fd-86c7-2add481c6ff0 service nova] Creating event network-changed:600465f3-a863-40a8-8e98-8ea8cd65d5a3 for instance 47783c4e-2d71-46f8-a964-e268979915ac on hv-cinder-86249 Oct 24 13:33:46.303918 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-aab86aca-7969-4fd6-8960-2ae32d9c8b8d req-f45de98f-c431-46fd-86c7-2add481c6ff0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037526 Oct 24 13:33:46.305104 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 439/872] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:33:46.473210 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a9191082-6414-4236-acd4-ce177639341a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:46.475028 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a9191082-6414-4236-acd4-ce177639341a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:46.480905 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a9191082-6414-4236-acd4-ce177639341a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:46.481374 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a9191082-6414-4236-acd4-ce177639341a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:46.481813 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a9191082-6414-4236-acd4-ce177639341a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:46.482515 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a9191082-6414-4236-acd4-ce177639341a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:46.483145 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a9191082-6414-4236-acd4-ce177639341a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:46.483741 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a9191082-6414-4236-acd4-ce177639341a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:46.558938 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a9191082-6414-4236-acd4-ce177639341a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:46.569508 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a9191082-6414-4236-acd4-ce177639341a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 200 len: 1297 microversion: 2.1 time: 0.100006 Oct 24 13:33:46.585067 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 434/873] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:46 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 1297 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:46.755632 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8ae24b35-a013-4d76-9518-aefbea7398ba tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:46.756392 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-8ae24b35-a013-4d76-9518-aefbea7398ba tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:46.762754 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8ae24b35-a013-4d76-9518-aefbea7398ba tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:46.763238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8ae24b35-a013-4d76-9518-aefbea7398ba tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:46.765182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8ae24b35-a013-4d76-9518-aefbea7398ba tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:46.765182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8ae24b35-a013-4d76-9518-aefbea7398ba tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:46.765182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8ae24b35-a013-4d76-9518-aefbea7398ba tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:46.765483 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8ae24b35-a013-4d76-9518-aefbea7398ba tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:46.847000 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-8ae24b35-a013-4d76-9518-aefbea7398ba tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:46.855073 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-8ae24b35-a013-4d76-9518-aefbea7398ba tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1186 microversion: 2.1 time: 0.104872 Oct 24 13:33:46.855650 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 440/874] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:46 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1186 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:47.593364 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ddbb0a50-6cab-421f-ad34-583b6df6fa91 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:47.594547 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-ddbb0a50-6cab-421f-ad34-583b6df6fa91 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:47.601486 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ddbb0a50-6cab-421f-ad34-583b6df6fa91 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:47.602190 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ddbb0a50-6cab-421f-ad34-583b6df6fa91 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:47.602797 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ddbb0a50-6cab-421f-ad34-583b6df6fa91 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:47.603702 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ddbb0a50-6cab-421f-ad34-583b6df6fa91 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:47.604355 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ddbb0a50-6cab-421f-ad34-583b6df6fa91 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:47.604939 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ddbb0a50-6cab-421f-ad34-583b6df6fa91 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:47.694684 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ddbb0a50-6cab-421f-ad34-583b6df6fa91 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:47.704586 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-ddbb0a50-6cab-421f-ad34-583b6df6fa91 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 200 len: 1295 microversion: 2.1 time: 0.114860 Oct 24 13:33:47.718337 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 435/875] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:47 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 1295 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:47.879085 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a3908375-a7fc-4d43-aae6-1d67d8437cc2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:47.879763 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a3908375-a7fc-4d43-aae6-1d67d8437cc2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:47.887421 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a3908375-a7fc-4d43-aae6-1d67d8437cc2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:47.888203 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a3908375-a7fc-4d43-aae6-1d67d8437cc2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:47.888754 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a3908375-a7fc-4d43-aae6-1d67d8437cc2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:47.889758 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a3908375-a7fc-4d43-aae6-1d67d8437cc2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:47.890403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a3908375-a7fc-4d43-aae6-1d67d8437cc2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:47.890992 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a3908375-a7fc-4d43-aae6-1d67d8437cc2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:47.955845 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-077157f2-3c04-444e-9ce4-1e585684e035 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:47.956980 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-077157f2-3c04-444e-9ce4-1e585684e035 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:47.964001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-077157f2-3c04-444e-9ce4-1e585684e035 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:47.964596 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-077157f2-3c04-444e-9ce4-1e585684e035 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:47.965713 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-077157f2-3c04-444e-9ce4-1e585684e035 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:47.966471 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-077157f2-3c04-444e-9ce4-1e585684e035 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:47.967160 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-077157f2-3c04-444e-9ce4-1e585684e035 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:47.967647 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-077157f2-3c04-444e-9ce4-1e585684e035 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:48.059072 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a3908375-a7fc-4d43-aae6-1d67d8437cc2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:48.061534 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.objects.instance [None req-077157f2-3c04-444e-9ce4-1e585684e035 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lazy-loading 'services' on Instance uuid 47783c4e-2d71-46f8-a964-e268979915ac {{(pid=119146) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:33:48.074522 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a3908375-a7fc-4d43-aae6-1d67d8437cc2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1204 microversion: 2.1 time: 0.199309 Oct 24 13:33:48.091404 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 441/876] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:47 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1204 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:48.315259 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-077157f2-3c04-444e-9ce4-1e585684e035 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "DELETE /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac/os-volume_attachments/f9e836f8-b812-4276-8154-8443e6703aa8" status: 202 len: 0 microversion: 2.1 time: 0.364095 Oct 24 13:33:48.331792 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 436/877] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 24 13:33:47 2022] DELETE /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac/os-volume_attachments/f9e836f8-b812-4276-8154-8443e6703aa8 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:33:48.335305 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-90739f17-373c-49c7-8e71-885f9d65d0b2 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:48.337948 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-90739f17-373c-49c7-8e71-885f9d65d0b2 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:48.352133 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-90739f17-373c-49c7-8e71-885f9d65d0b2 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:48.352578 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-91120eea-ca43-4650-bfc3-fb94b1db7e85 req-67c283dd-6481-4f5c-b032-3d2cbd11b181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47783c4e-2d71-46f8-a964-e268979915ac", "tag": "600465f3-a863-40a8-8e98-8ea8cd65d5a3"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:33:48.359164 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-90739f17-373c-49c7-8e71-885f9d65d0b2 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:48.360851 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-90739f17-373c-49c7-8e71-885f9d65d0b2 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:48.360851 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-90739f17-373c-49c7-8e71-885f9d65d0b2 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:48.361525 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-90739f17-373c-49c7-8e71-885f9d65d0b2 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:48.362226 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-90739f17-373c-49c7-8e71-885f9d65d0b2 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:48.372528 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-91120eea-ca43-4650-bfc3-fb94b1db7e85 req-67c283dd-6481-4f5c-b032-3d2cbd11b181 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:48.373857 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-91120eea-ca43-4650-bfc3-fb94b1db7e85 req-67c283dd-6481-4f5c-b032-3d2cbd11b181 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:48.374451 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-91120eea-ca43-4650-bfc3-fb94b1db7e85 req-67c283dd-6481-4f5c-b032-3d2cbd11b181 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:48.391857 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-91120eea-ca43-4650-bfc3-fb94b1db7e85 req-67c283dd-6481-4f5c-b032-3d2cbd11b181 service nova] Creating event network-changed:600465f3-a863-40a8-8e98-8ea8cd65d5a3 for instance 47783c4e-2d71-46f8-a964-e268979915ac on hv-cinder-86249 Oct 24 13:33:48.398282 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-90739f17-373c-49c7-8e71-885f9d65d0b2 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076962 Oct 24 13:33:48.404481 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-91120eea-ca43-4650-bfc3-fb94b1db7e85 req-67c283dd-6481-4f5c-b032-3d2cbd11b181 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059994 Oct 24 13:33:48.404764 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 442/878] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 24 13:33:48 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:33:48.405221 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 437/879] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:33:48.730637 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f1a3631a-5ba3-464d-9ddf-2f92138bc38e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:48.731715 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f1a3631a-5ba3-464d-9ddf-2f92138bc38e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:48.743013 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f1a3631a-5ba3-464d-9ddf-2f92138bc38e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:48.744087 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f1a3631a-5ba3-464d-9ddf-2f92138bc38e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:48.744527 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f1a3631a-5ba3-464d-9ddf-2f92138bc38e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:48.745229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f1a3631a-5ba3-464d-9ddf-2f92138bc38e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:48.745675 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f1a3631a-5ba3-464d-9ddf-2f92138bc38e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:48.746099 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f1a3631a-5ba3-464d-9ddf-2f92138bc38e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:48.944053 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f1a3631a-5ba3-464d-9ddf-2f92138bc38e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:48.952499 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f1a3631a-5ba3-464d-9ddf-2f92138bc38e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 200 len: 1362 microversion: 2.1 time: 0.226821 Oct 24 13:33:48.953109 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 443/880] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:48 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:49.100066 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c2a1f75f-62b8-43ee-9a44-92043ef475cc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:49.101536 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c2a1f75f-62b8-43ee-9a44-92043ef475cc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:49.107584 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c2a1f75f-62b8-43ee-9a44-92043ef475cc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:49.108072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c2a1f75f-62b8-43ee-9a44-92043ef475cc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:49.108539 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c2a1f75f-62b8-43ee-9a44-92043ef475cc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:49.109250 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c2a1f75f-62b8-43ee-9a44-92043ef475cc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:49.109699 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c2a1f75f-62b8-43ee-9a44-92043ef475cc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:49.115877 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c2a1f75f-62b8-43ee-9a44-92043ef475cc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:49.253921 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c2a1f75f-62b8-43ee-9a44-92043ef475cc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:49.263232 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c2a1f75f-62b8-43ee-9a44-92043ef475cc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1270 microversion: 2.1 time: 0.167887 Oct 24 13:33:49.263855 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 438/881] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:49 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:49.414151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a67874bd-84b3-4274-b02b-6857ed2d7685 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:49.416483 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a67874bd-84b3-4274-b02b-6857ed2d7685 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:49.422689 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a67874bd-84b3-4274-b02b-6857ed2d7685 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:49.426112 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a67874bd-84b3-4274-b02b-6857ed2d7685 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:49.426112 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a67874bd-84b3-4274-b02b-6857ed2d7685 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:49.426112 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a67874bd-84b3-4274-b02b-6857ed2d7685 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:49.426112 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a67874bd-84b3-4274-b02b-6857ed2d7685 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:49.426519 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a67874bd-84b3-4274-b02b-6857ed2d7685 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:49.456011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a67874bd-84b3-4274-b02b-6857ed2d7685 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046166 Oct 24 13:33:49.456618 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 444/882] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 24 13:33:49 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:33:49.975814 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-97cca927-857a-4e4c-b7af-8878b4951518 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:49.976460 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-97cca927-857a-4e4c-b7af-8878b4951518 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:49.982845 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-97cca927-857a-4e4c-b7af-8878b4951518 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:49.983339 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-97cca927-857a-4e4c-b7af-8878b4951518 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:49.983775 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-97cca927-857a-4e4c-b7af-8878b4951518 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:49.984515 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-97cca927-857a-4e4c-b7af-8878b4951518 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:49.984977 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-97cca927-857a-4e4c-b7af-8878b4951518 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:49.985402 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-97cca927-857a-4e4c-b7af-8878b4951518 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:50.117912 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-97cca927-857a-4e4c-b7af-8878b4951518 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:50.125945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-97cca927-857a-4e4c-b7af-8878b4951518 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 200 len: 1362 microversion: 2.1 time: 0.154748 Oct 24 13:33:50.126555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 439/883] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:49 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:50.286079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-34ee5500-b9dd-4b29-83aa-4bb97bdc059b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:50.287325 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-34ee5500-b9dd-4b29-83aa-4bb97bdc059b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:50.293645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34ee5500-b9dd-4b29-83aa-4bb97bdc059b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:50.294116 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34ee5500-b9dd-4b29-83aa-4bb97bdc059b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:50.295084 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34ee5500-b9dd-4b29-83aa-4bb97bdc059b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:50.295772 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34ee5500-b9dd-4b29-83aa-4bb97bdc059b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:50.296317 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34ee5500-b9dd-4b29-83aa-4bb97bdc059b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:50.296647 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-34ee5500-b9dd-4b29-83aa-4bb97bdc059b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:50.467577 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-34ee5500-b9dd-4b29-83aa-4bb97bdc059b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:50.469359 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3a4cc697-21df-4001-8c41-44f96f4f5892 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:50.472209 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-3a4cc697-21df-4001-8c41-44f96f4f5892 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:50.475869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-34ee5500-b9dd-4b29-83aa-4bb97bdc059b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1258 microversion: 2.1 time: 0.193582 Oct 24 13:33:50.479159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3a4cc697-21df-4001-8c41-44f96f4f5892 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:50.479768 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3a4cc697-21df-4001-8c41-44f96f4f5892 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:50.480325 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3a4cc697-21df-4001-8c41-44f96f4f5892 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:50.481104 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3a4cc697-21df-4001-8c41-44f96f4f5892 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:50.481649 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3a4cc697-21df-4001-8c41-44f96f4f5892 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:50.482215 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3a4cc697-21df-4001-8c41-44f96f4f5892 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:50.488616 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 445/884] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:50 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1258 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:50.513172 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3a4cc697-21df-4001-8c41-44f96f4f5892 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048606 Oct 24 13:33:50.513853 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 440/885] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 24 13:33:50 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 13:33:50.525126 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-001deda8-1ee5-4f41-ae1d-9cb033eb4f1a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:50.525609 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-001deda8-1ee5-4f41-ae1d-9cb033eb4f1a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:50.531629 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-001deda8-1ee5-4f41-ae1d-9cb033eb4f1a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:50.532107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-001deda8-1ee5-4f41-ae1d-9cb033eb4f1a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:50.532919 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-001deda8-1ee5-4f41-ae1d-9cb033eb4f1a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:50.533252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-001deda8-1ee5-4f41-ae1d-9cb033eb4f1a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:50.533695 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-001deda8-1ee5-4f41-ae1d-9cb033eb4f1a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:50.534108 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-001deda8-1ee5-4f41-ae1d-9cb033eb4f1a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:50.610451 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-001deda8-1ee5-4f41-ae1d-9cb033eb4f1a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] HTTP exception thrown: Instance 47783c4e-2d71-46f8-a964-e268979915ac is not attached to volume f9e836f8-b812-4276-8154-8443e6703aa8 Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-001deda8-1ee5-4f41-ae1d-9cb033eb4f1a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Request method failure captured: Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: DELETE /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac/os-volume_attachments/f9e836f8-b812-4276-8154-8443e6703aa8 HTTP/1.1 Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpLi38QCGBRqbtn8ADP_HhwHjRX2eOi1H1OnjwI9Zy9YOACMk3zGJaCNpASfDOhGkz2TFSw5oH5Vn5TCZOZOoLCjL-8TXUddygwFb-axMT7fDsEMbJB14Ahd8nnLv-_2xH1Hcg76_FPfYMJtE8nksILgNhof7OF1ix4izNJa-CUb1vE Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: 1742dccd5a764a31ab1a228ead5cdab9 Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-TestMinimumBasicScenario-1479834024 Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:33:50.618621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:33:50.620259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1742dccd5a764a31ab1a228ead5cdab9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1742dccd5a764a31ab1a228ead5cdab9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1742dccd5a764a31ab1a228ead5cdab9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1742dccd5a764a31ab1a228ead5cdab9"}]}] Oct 24 13:33:50.620259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-TestMinimumBasicScenario-1479834024 Oct 24 13:33:50.620259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: 1742dccd5a764a31ab1a228ead5cdab9 Oct 24 13:33:50.620259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1479834024 Oct 24 13:33:50.620259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-TestMinimumBasicScenario-1479834024-project Oct 24 13:33:50.620259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:33:50.620259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:33:50.620259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 834b92eb61864d1b95e9f037379c2e13 Oct 24 13:33:50.620259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-TestMinimumBasicScenario-1479834024-project Oct 24 13:33:50.620259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:33:50.620259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance 47783c4e-2d71-46f8-a964-e268979915ac is not attached to volume f9e836f8-b812-4276-8154-8443e6703aa8 Oct 24 13:33:50.621163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'server_id': '47783c4e-2d71-46f8-a964-e268979915ac', 'id': 'f9e836f8-b812-4276-8154-8443e6703aa8'} Oct 24 13:33:50.621163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:33:50.621163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:33:50.621163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 24 13:33:50.621163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 24 13:33:50.621163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:33:50.621163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:33:50.621163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 24 13:33:50.621163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 24 13:33:50.621163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f9e836f8-b812-4276-8154-8443e6703aa8. Oct 24 13:33:50.621163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:33:50.621163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:33:50.621163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:33:50.621163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:33:50.621163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:33:50.621163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:33:50.621163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:33:50.621163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:33:50.621163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:33:50.622619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:33:50.622619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 24 13:33:50.622619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 13:33:50.622619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47783c4e-2d71-46f8-a964-e268979915ac is not attached to volume f9e836f8-b812-4276-8154-8443e6703aa8 Oct 24 13:33:50.622619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:33:50.622619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:33:50.622619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:33:50.622619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:33:50.622619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:33:50.622619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:33:50.622619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:33:50.622619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:33:50.622619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47783c4e-2d71-46f8-a964-e268979915ac is not attached to volume f9e836f8-b812-4276-8154-8443e6703aa8 Oct 24 13:33:50.622619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:33:50.622619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-001deda8-1ee5-4f41-ae1d-9cb033eb4f1a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Returning 404 to user: Instance 47783c4e-2d71-46f8-a964-e268979915ac is not attached to volume f9e836f8-b812-4276-8154-8443e6703aa8 {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:33:50.623740 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-001deda8-1ee5-4f41-ae1d-9cb033eb4f1a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "DELETE /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac/os-volume_attachments/f9e836f8-b812-4276-8154-8443e6703aa8" status: 404 len: 154 microversion: 2.1 time: 0.099559 Oct 24 13:33:50.623740 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 446/886] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 24 13:33:50 2022] DELETE /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac/os-volume_attachments/f9e836f8-b812-4276-8154-8443e6703aa8 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:33:51.041589 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-1003a93b-891d-43c8-98ba-1b690bda6d01 req-99425ac8-9d63-4a70-8222-ceb92c3c40cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25ad1362-6db1-48be-8ddb-3fa0b0f78404", "tag": "70dbb5cd-19fd-4c0e-b47a-955a76e67b6b"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:33:51.051248 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-1003a93b-891d-43c8-98ba-1b690bda6d01 req-99425ac8-9d63-4a70-8222-ceb92c3c40cb service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:51.051727 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-1003a93b-891d-43c8-98ba-1b690bda6d01 req-99425ac8-9d63-4a70-8222-ceb92c3c40cb service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:51.052691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-1003a93b-891d-43c8-98ba-1b690bda6d01 req-99425ac8-9d63-4a70-8222-ceb92c3c40cb service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:51.064249 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-1003a93b-891d-43c8-98ba-1b690bda6d01 req-99425ac8-9d63-4a70-8222-ceb92c3c40cb service nova] Creating event network-changed:70dbb5cd-19fd-4c0e-b47a-955a76e67b6b for instance 25ad1362-6db1-48be-8ddb-3fa0b0f78404 on hv-cinder-86249 Oct 24 13:33:51.070042 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-1003a93b-891d-43c8-98ba-1b690bda6d01 req-99425ac8-9d63-4a70-8222-ceb92c3c40cb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032627 Oct 24 13:33:51.070660 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 441/887] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:33:51.149946 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-152f1acb-23f5-417f-a8e5-a54c32d205e0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:51.150556 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-152f1acb-23f5-417f-a8e5-a54c32d205e0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:51.156800 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-152f1acb-23f5-417f-a8e5-a54c32d205e0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:51.157429 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-152f1acb-23f5-417f-a8e5-a54c32d205e0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:51.157858 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-152f1acb-23f5-417f-a8e5-a54c32d205e0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:51.158544 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-152f1acb-23f5-417f-a8e5-a54c32d205e0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:51.158992 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-152f1acb-23f5-417f-a8e5-a54c32d205e0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:51.159410 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-152f1acb-23f5-417f-a8e5-a54c32d205e0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:51.483732 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-152f1acb-23f5-417f-a8e5-a54c32d205e0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:51.492514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-152f1acb-23f5-417f-a8e5-a54c32d205e0 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 200 len: 1362 microversion: 2.1 time: 0.347309 Oct 24 13:33:51.493330 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 447/888] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:51 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 1362 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:51.499647 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8fc4dcbb-4389-4149-b6da-0a194a5652eb tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:51.500461 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8fc4dcbb-4389-4149-b6da-0a194a5652eb tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:51.507359 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8fc4dcbb-4389-4149-b6da-0a194a5652eb tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:51.507849 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8fc4dcbb-4389-4149-b6da-0a194a5652eb tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:51.508307 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8fc4dcbb-4389-4149-b6da-0a194a5652eb tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:51.509005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8fc4dcbb-4389-4149-b6da-0a194a5652eb tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:51.509501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8fc4dcbb-4389-4149-b6da-0a194a5652eb tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:51.509923 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8fc4dcbb-4389-4149-b6da-0a194a5652eb tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:51.644878 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8fc4dcbb-4389-4149-b6da-0a194a5652eb tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:51.653111 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8fc4dcbb-4389-4149-b6da-0a194a5652eb tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1258 microversion: 2.1 time: 0.157927 Oct 24 13:33:51.653680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 442/889] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:51 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:51.899843 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9edc5fa2-b14a-4610-8a7d-a3eb591f3ee5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:51.900361 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9edc5fa2-b14a-4610-8a7d-a3eb591f3ee5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:51.906441 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9edc5fa2-b14a-4610-8a7d-a3eb591f3ee5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:51.906899 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9edc5fa2-b14a-4610-8a7d-a3eb591f3ee5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:51.907317 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9edc5fa2-b14a-4610-8a7d-a3eb591f3ee5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:51.907994 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9edc5fa2-b14a-4610-8a7d-a3eb591f3ee5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:51.908479 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9edc5fa2-b14a-4610-8a7d-a3eb591f3ee5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:51.908887 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9edc5fa2-b14a-4610-8a7d-a3eb591f3ee5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:51.933313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9edc5fa2-b14a-4610-8a7d-a3eb591f3ee5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Going to try to terminate instance {{(pid=119145) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:33:51.968511 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:52.205648 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9edc5fa2-b14a-4610-8a7d-a3eb591f3ee5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "DELETE /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 204 len: 0 microversion: 2.1 time: 0.310114 Oct 24 13:33:52.206242 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 448/890] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:33:51 2022] DELETE /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:33:52.214714 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c9d2bb2c-c80e-47fa-a6d3-592027f925d5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:52.215384 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c9d2bb2c-c80e-47fa-a6d3-592027f925d5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:52.221489 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c9d2bb2c-c80e-47fa-a6d3-592027f925d5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:52.223156 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c9d2bb2c-c80e-47fa-a6d3-592027f925d5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:52.223156 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c9d2bb2c-c80e-47fa-a6d3-592027f925d5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:52.223156 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c9d2bb2c-c80e-47fa-a6d3-592027f925d5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:52.223582 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c9d2bb2c-c80e-47fa-a6d3-592027f925d5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:52.224100 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c9d2bb2c-c80e-47fa-a6d3-592027f925d5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:52.354898 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c9d2bb2c-c80e-47fa-a6d3-592027f925d5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:52.362497 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c9d2bb2c-c80e-47fa-a6d3-592027f925d5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1555 microversion: 2.1 time: 0.151978 Oct 24 13:33:52.363059 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 443/891] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:52 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:52.515100 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8b35fdbb-aab6-44c6-8f13-b633d522b5b3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:52.515717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-8b35fdbb-aab6-44c6-8f13-b633d522b5b3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:52.521606 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8b35fdbb-aab6-44c6-8f13-b633d522b5b3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:52.522076 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8b35fdbb-aab6-44c6-8f13-b633d522b5b3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:52.522496 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8b35fdbb-aab6-44c6-8f13-b633d522b5b3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:52.523165 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8b35fdbb-aab6-44c6-8f13-b633d522b5b3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:52.523606 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8b35fdbb-aab6-44c6-8f13-b633d522b5b3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:52.524019 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8b35fdbb-aab6-44c6-8f13-b633d522b5b3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:52.649865 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-8b35fdbb-aab6-44c6-8f13-b633d522b5b3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:52.657333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-8b35fdbb-aab6-44c6-8f13-b633d522b5b3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 200 len: 1362 microversion: 2.1 time: 0.146508 Oct 24 13:33:52.657892 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 449/892] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:52 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:52.676335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-25582f76-1ddf-4d0b-9e80-0b51551ed4e3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:52.677555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-25582f76-1ddf-4d0b-9e80-0b51551ed4e3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:52.683903 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-25582f76-1ddf-4d0b-9e80-0b51551ed4e3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:52.684414 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-25582f76-1ddf-4d0b-9e80-0b51551ed4e3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:52.684853 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-25582f76-1ddf-4d0b-9e80-0b51551ed4e3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:52.685531 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-25582f76-1ddf-4d0b-9e80-0b51551ed4e3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:52.685980 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-25582f76-1ddf-4d0b-9e80-0b51551ed4e3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:52.686397 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-25582f76-1ddf-4d0b-9e80-0b51551ed4e3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:52.815120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-25582f76-1ddf-4d0b-9e80-0b51551ed4e3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:52.822696 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-25582f76-1ddf-4d0b-9e80-0b51551ed4e3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1258 microversion: 2.1 time: 0.150197 Oct 24 13:33:52.823261 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 444/893] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:52 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:53.086182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-b933d1a1-335d-48ac-b4cf-8ac89b360798 req-49171b77-a297-40c6-9d0e-3d3e3d6a1e17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "937175c3-4262-4fe8-acfc-69bd009df2ac", "tag": "28395180-00b3-4e86-b35a-bac15da8261a"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:33:53.095881 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-b933d1a1-335d-48ac-b4cf-8ac89b360798 req-49171b77-a297-40c6-9d0e-3d3e3d6a1e17 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:53.096379 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-b933d1a1-335d-48ac-b4cf-8ac89b360798 req-49171b77-a297-40c6-9d0e-3d3e3d6a1e17 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:53.096797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-b933d1a1-335d-48ac-b4cf-8ac89b360798 req-49171b77-a297-40c6-9d0e-3d3e3d6a1e17 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:53.108074 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-b933d1a1-335d-48ac-b4cf-8ac89b360798 req-49171b77-a297-40c6-9d0e-3d3e3d6a1e17 service nova] Creating event network-changed:28395180-00b3-4e86-b35a-bac15da8261a for instance 937175c3-4262-4fe8-acfc-69bd009df2ac on hv-cinder-86249 Oct 24 13:33:53.115216 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-b933d1a1-335d-48ac-b4cf-8ac89b360798 req-49171b77-a297-40c6-9d0e-3d3e3d6a1e17 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030736 Oct 24 13:33:53.115216 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 450/894] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:33:53.386998 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ccbb6bae-bf6b-47ac-b482-6b34a08530d1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:53.387606 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-ccbb6bae-bf6b-47ac-b482-6b34a08530d1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:53.394565 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ccbb6bae-bf6b-47ac-b482-6b34a08530d1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:53.395044 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ccbb6bae-bf6b-47ac-b482-6b34a08530d1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:53.396146 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ccbb6bae-bf6b-47ac-b482-6b34a08530d1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:53.396874 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ccbb6bae-bf6b-47ac-b482-6b34a08530d1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:53.397326 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ccbb6bae-bf6b-47ac-b482-6b34a08530d1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:53.397748 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ccbb6bae-bf6b-47ac-b482-6b34a08530d1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:53.525835 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ccbb6bae-bf6b-47ac-b482-6b34a08530d1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:53.529363 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:53.533862 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-ccbb6bae-bf6b-47ac-b482-6b34a08530d1 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1555 microversion: 2.1 time: 0.151018 Oct 24 13:33:53.534432 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 445/895] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:53 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:53.681056 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ad8cfea6-a3ac-497a-bb29-8adc50e3b93f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:53.681746 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ad8cfea6-a3ac-497a-bb29-8adc50e3b93f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:53.687743 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ad8cfea6-a3ac-497a-bb29-8adc50e3b93f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:53.688215 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ad8cfea6-a3ac-497a-bb29-8adc50e3b93f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:53.688665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ad8cfea6-a3ac-497a-bb29-8adc50e3b93f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:53.689331 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ad8cfea6-a3ac-497a-bb29-8adc50e3b93f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:53.689774 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ad8cfea6-a3ac-497a-bb29-8adc50e3b93f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:53.690187 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ad8cfea6-a3ac-497a-bb29-8adc50e3b93f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:53.818439 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ad8cfea6-a3ac-497a-bb29-8adc50e3b93f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:53.826322 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ad8cfea6-a3ac-497a-bb29-8adc50e3b93f tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 200 len: 1362 microversion: 2.1 time: 0.149890 Oct 24 13:33:53.826870 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 451/896] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:53 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:53.845705 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-02e07d5c-88fd-40ac-8077-616d669263bc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:53.846317 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-02e07d5c-88fd-40ac-8077-616d669263bc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:53.852667 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-02e07d5c-88fd-40ac-8077-616d669263bc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:53.853148 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-02e07d5c-88fd-40ac-8077-616d669263bc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:53.853581 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-02e07d5c-88fd-40ac-8077-616d669263bc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:53.854263 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-02e07d5c-88fd-40ac-8077-616d669263bc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:53.854715 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-02e07d5c-88fd-40ac-8077-616d669263bc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:53.855135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-02e07d5c-88fd-40ac-8077-616d669263bc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:53.982598 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-02e07d5c-88fd-40ac-8077-616d669263bc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:53.990786 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-02e07d5c-88fd-40ac-8077-616d669263bc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1258 microversion: 2.1 time: 0.149318 Oct 24 13:33:53.994001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 446/897] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:53 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:54.556752 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-be4ebb28-e10f-462d-abfd-b1d9ac05322f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:54.557361 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-be4ebb28-e10f-462d-abfd-b1d9ac05322f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:54.559734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=10 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:54.564532 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-be4ebb28-e10f-462d-abfd-b1d9ac05322f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:54.565007 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-be4ebb28-e10f-462d-abfd-b1d9ac05322f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:54.565434 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-be4ebb28-e10f-462d-abfd-b1d9ac05322f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:54.567041 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-be4ebb28-e10f-462d-abfd-b1d9ac05322f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:54.567041 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-be4ebb28-e10f-462d-abfd-b1d9ac05322f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:54.567041 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-be4ebb28-e10f-462d-abfd-b1d9ac05322f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:54.697517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-be4ebb28-e10f-462d-abfd-b1d9ac05322f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:54.705408 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-be4ebb28-e10f-462d-abfd-b1d9ac05322f tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1555 microversion: 2.1 time: 0.152469 Oct 24 13:33:54.705976 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 452/898] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:54 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:54.847803 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-2b293b82-630d-49fb-aca8-990497f748d3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:54.848520 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-2b293b82-630d-49fb-aca8-990497f748d3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:54.850406 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=4 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:54.851071 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=16 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:54.856223 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2b293b82-630d-49fb-aca8-990497f748d3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:54.856781 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2b293b82-630d-49fb-aca8-990497f748d3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:54.857215 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2b293b82-630d-49fb-aca8-990497f748d3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:54.857896 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2b293b82-630d-49fb-aca8-990497f748d3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:54.858343 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2b293b82-630d-49fb-aca8-990497f748d3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:54.858760 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2b293b82-630d-49fb-aca8-990497f748d3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:54.985520 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-2b293b82-630d-49fb-aca8-990497f748d3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:54.993548 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-2b293b82-630d-49fb-aca8-990497f748d3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 200 len: 1362 microversion: 2.1 time: 0.149570 Oct 24 13:33:54.994126 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 447/899] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:54 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:55.014281 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-eb2b5a5e-28ff-414b-a734-f02ac10c2a38 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:55.014942 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-eb2b5a5e-28ff-414b-a734-f02ac10c2a38 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:55.021775 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-eb2b5a5e-28ff-414b-a734-f02ac10c2a38 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:55.022252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-eb2b5a5e-28ff-414b-a734-f02ac10c2a38 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:55.022689 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-eb2b5a5e-28ff-414b-a734-f02ac10c2a38 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:55.023366 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-eb2b5a5e-28ff-414b-a734-f02ac10c2a38 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:55.023812 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-eb2b5a5e-28ff-414b-a734-f02ac10c2a38 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:55.024234 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-eb2b5a5e-28ff-414b-a734-f02ac10c2a38 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:55.153333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-eb2b5a5e-28ff-414b-a734-f02ac10c2a38 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:55.160991 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-eb2b5a5e-28ff-414b-a734-f02ac10c2a38 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1258 microversion: 2.1 time: 0.150620 Oct 24 13:33:55.161561 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 453/900] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:55 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:33:55.729390 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-303608a3-126f-4325-b0d1-abe274ed75c8 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:55.730012 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-303608a3-126f-4325-b0d1-abe274ed75c8 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:55.735863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-303608a3-126f-4325-b0d1-abe274ed75c8 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:55.736368 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-303608a3-126f-4325-b0d1-abe274ed75c8 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:55.736814 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-303608a3-126f-4325-b0d1-abe274ed75c8 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:55.737487 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-303608a3-126f-4325-b0d1-abe274ed75c8 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:55.737935 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-303608a3-126f-4325-b0d1-abe274ed75c8 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:55.738357 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-303608a3-126f-4325-b0d1-abe274ed75c8 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:55.873437 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-303608a3-126f-4325-b0d1-abe274ed75c8 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:55.881348 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-303608a3-126f-4325-b0d1-abe274ed75c8 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1555 microversion: 2.1 time: 0.155791 Oct 24 13:33:55.881918 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 448/901] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:55 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:56.017543 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-2c0ee1f1-1adc-4bec-b6ef-60f3518cf88b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:56.018145 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-2c0ee1f1-1adc-4bec-b6ef-60f3518cf88b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:56.025509 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2c0ee1f1-1adc-4bec-b6ef-60f3518cf88b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:56.025981 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2c0ee1f1-1adc-4bec-b6ef-60f3518cf88b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:56.026535 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2c0ee1f1-1adc-4bec-b6ef-60f3518cf88b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:56.027216 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2c0ee1f1-1adc-4bec-b6ef-60f3518cf88b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:56.027667 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2c0ee1f1-1adc-4bec-b6ef-60f3518cf88b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:56.028075 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2c0ee1f1-1adc-4bec-b6ef-60f3518cf88b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:56.183455 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b17ff7ac-0da2-4647-9c42-1e0589105f5e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:56.184012 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b17ff7ac-0da2-4647-9c42-1e0589105f5e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:56.190152 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b17ff7ac-0da2-4647-9c42-1e0589105f5e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:56.190634 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b17ff7ac-0da2-4647-9c42-1e0589105f5e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:56.191066 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b17ff7ac-0da2-4647-9c42-1e0589105f5e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:56.191756 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b17ff7ac-0da2-4647-9c42-1e0589105f5e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:56.192203 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b17ff7ac-0da2-4647-9c42-1e0589105f5e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:56.192679 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b17ff7ac-0da2-4647-9c42-1e0589105f5e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:56.196155 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-2c0ee1f1-1adc-4bec-b6ef-60f3518cf88b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:56.204842 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-2c0ee1f1-1adc-4bec-b6ef-60f3518cf88b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 200 len: 1362 microversion: 2.1 time: 0.191353 Oct 24 13:33:56.208509 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 454/902] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:56 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:56.321974 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b17ff7ac-0da2-4647-9c42-1e0589105f5e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:56.329874 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b17ff7ac-0da2-4647-9c42-1e0589105f5e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1258 microversion: 2.1 time: 0.150602 Oct 24 13:33:56.330449 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 449/903] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:56 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:33:56.904550 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-35888319-ae2c-49d7-8765-d78cc875464a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:56.905167 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-35888319-ae2c-49d7-8765-d78cc875464a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:56.911099 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-35888319-ae2c-49d7-8765-d78cc875464a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:56.911583 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-35888319-ae2c-49d7-8765-d78cc875464a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:56.912054 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-35888319-ae2c-49d7-8765-d78cc875464a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:56.912834 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-35888319-ae2c-49d7-8765-d78cc875464a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:56.913284 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-35888319-ae2c-49d7-8765-d78cc875464a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:56.913701 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-35888319-ae2c-49d7-8765-d78cc875464a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:57.040606 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-35888319-ae2c-49d7-8765-d78cc875464a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:57.048192 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-35888319-ae2c-49d7-8765-d78cc875464a tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1555 microversion: 2.1 time: 0.147576 Oct 24 13:33:57.048786 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 455/904] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:56 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:57.228752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-cdcfe8b0-7ffc-4f1d-aa66-8e937af813fc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:57.229305 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-cdcfe8b0-7ffc-4f1d-aa66-8e937af813fc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:57.235846 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cdcfe8b0-7ffc-4f1d-aa66-8e937af813fc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:57.236361 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cdcfe8b0-7ffc-4f1d-aa66-8e937af813fc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:57.236794 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cdcfe8b0-7ffc-4f1d-aa66-8e937af813fc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:57.237485 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cdcfe8b0-7ffc-4f1d-aa66-8e937af813fc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:57.237955 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cdcfe8b0-7ffc-4f1d-aa66-8e937af813fc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:57.238360 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cdcfe8b0-7ffc-4f1d-aa66-8e937af813fc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:57.355800 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-2ac6db41-891e-4b54-9f07-20d0b2c6b1e1 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:57.356642 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-2ac6db41-891e-4b54-9f07-20d0b2c6b1e1 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:57.362736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2ac6db41-891e-4b54-9f07-20d0b2c6b1e1 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:57.363294 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2ac6db41-891e-4b54-9f07-20d0b2c6b1e1 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:57.364861 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2ac6db41-891e-4b54-9f07-20d0b2c6b1e1 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:57.365156 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2ac6db41-891e-4b54-9f07-20d0b2c6b1e1 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:57.365697 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2ac6db41-891e-4b54-9f07-20d0b2c6b1e1 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:57.366181 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2ac6db41-891e-4b54-9f07-20d0b2c6b1e1 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:57.375485 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-cdcfe8b0-7ffc-4f1d-aa66-8e937af813fc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:57.383408 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-cdcfe8b0-7ffc-4f1d-aa66-8e937af813fc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 200 len: 1362 microversion: 2.1 time: 0.158543 Oct 24 13:33:57.384196 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 450/905] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:57 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:33:57.667880 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-2ac6db41-891e-4b54-9f07-20d0b2c6b1e1 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:57.675453 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-2ac6db41-891e-4b54-9f07-20d0b2c6b1e1 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1258 microversion: 2.1 time: 0.323661 Oct 24 13:33:57.693233 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 456/906] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:57 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1258 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:33:57.970034 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-c41873ba-ee96-4dc3-86e8-f52d4768c4fb req-65b79cc0-7a16-4867-bccb-9af18652964a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47783c4e-2d71-46f8-a964-e268979915ac", "name": "network-vif-deleted", "tag": "600465f3-a863-40a8-8e98-8ea8cd65d5a3"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:33:57.976937 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-8b504084-d0d2-4c9d-bfd6-99a076332448 req-fe907eb8-b6f4-4353-9071-a6b8953b27f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "937175c3-4262-4fe8-acfc-69bd009df2ac", "name": "network-vif-plugged", "status": "completed", "tag": "28395180-00b3-4e86-b35a-bac15da8261a"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:33:57.979660 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-c41873ba-ee96-4dc3-86e8-f52d4768c4fb req-65b79cc0-7a16-4867-bccb-9af18652964a service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:57.980082 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-c41873ba-ee96-4dc3-86e8-f52d4768c4fb req-65b79cc0-7a16-4867-bccb-9af18652964a service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:57.980529 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-c41873ba-ee96-4dc3-86e8-f52d4768c4fb req-65b79cc0-7a16-4867-bccb-9af18652964a service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:57.988700 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-8b504084-d0d2-4c9d-bfd6-99a076332448 req-fe907eb8-b6f4-4353-9071-a6b8953b27f8 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:57.989178 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-8b504084-d0d2-4c9d-bfd6-99a076332448 req-fe907eb8-b6f4-4353-9071-a6b8953b27f8 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:57.989649 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-8b504084-d0d2-4c9d-bfd6-99a076332448 req-fe907eb8-b6f4-4353-9071-a6b8953b27f8 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:57.991582 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-c41873ba-ee96-4dc3-86e8-f52d4768c4fb req-65b79cc0-7a16-4867-bccb-9af18652964a service nova] Creating event network-vif-deleted:600465f3-a863-40a8-8e98-8ea8cd65d5a3 for instance 47783c4e-2d71-46f8-a964-e268979915ac on hv-cinder-86249 Oct 24 13:33:57.996900 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-c41873ba-ee96-4dc3-86e8-f52d4768c4fb req-65b79cc0-7a16-4867-bccb-9af18652964a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030330 Oct 24 13:33:57.998180 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 451/907] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:33:58.000956 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-8b504084-d0d2-4c9d-bfd6-99a076332448 req-fe907eb8-b6f4-4353-9071-a6b8953b27f8 service nova] Creating event network-vif-plugged:28395180-00b3-4e86-b35a-bac15da8261a for instance 937175c3-4262-4fe8-acfc-69bd009df2ac on hv-cinder-86249 Oct 24 13:33:58.006315 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-8b504084-d0d2-4c9d-bfd6-99a076332448 req-fe907eb8-b6f4-4353-9071-a6b8953b27f8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033642 Oct 24 13:33:58.006893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 457/908] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:33:58.072217 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-72c683e9-6277-4334-a82d-6a0794788bda tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:58.072939 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-72c683e9-6277-4334-a82d-6a0794788bda tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:58.079388 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72c683e9-6277-4334-a82d-6a0794788bda tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:58.079869 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72c683e9-6277-4334-a82d-6a0794788bda tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:58.080326 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72c683e9-6277-4334-a82d-6a0794788bda tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:58.081297 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72c683e9-6277-4334-a82d-6a0794788bda tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:58.081488 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72c683e9-6277-4334-a82d-6a0794788bda tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:58.081895 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72c683e9-6277-4334-a82d-6a0794788bda tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:58.149694 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-72c683e9-6277-4334-a82d-6a0794788bda tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:58.157839 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-72c683e9-6277-4334-a82d-6a0794788bda tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1513 microversion: 2.1 time: 0.090455 Oct 24 13:33:58.159191 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 452/909] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:58 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1513 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:33:58.405953 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c5a42da4-9379-414b-8aa7-f1ff5fc928dc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:58.406646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-c5a42da4-9379-414b-8aa7-f1ff5fc928dc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:58.413954 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c5a42da4-9379-414b-8aa7-f1ff5fc928dc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:58.414420 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c5a42da4-9379-414b-8aa7-f1ff5fc928dc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:58.414844 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c5a42da4-9379-414b-8aa7-f1ff5fc928dc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:58.415521 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c5a42da4-9379-414b-8aa7-f1ff5fc928dc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:58.415962 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c5a42da4-9379-414b-8aa7-f1ff5fc928dc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:58.416420 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c5a42da4-9379-414b-8aa7-f1ff5fc928dc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:58.549016 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c5a42da4-9379-414b-8aa7-f1ff5fc928dc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:58.557365 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-c5a42da4-9379-414b-8aa7-f1ff5fc928dc tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 200 len: 1362 microversion: 2.1 time: 0.155555 Oct 24 13:33:58.557942 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 458/910] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:58 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:58.702220 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8874a0f5-6088-4a21-bff4-6afed66ec8bf tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:58.702991 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8874a0f5-6088-4a21-bff4-6afed66ec8bf tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:58.709463 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8874a0f5-6088-4a21-bff4-6afed66ec8bf tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:58.709954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8874a0f5-6088-4a21-bff4-6afed66ec8bf tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:58.710430 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8874a0f5-6088-4a21-bff4-6afed66ec8bf tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:58.711192 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8874a0f5-6088-4a21-bff4-6afed66ec8bf tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:58.711645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8874a0f5-6088-4a21-bff4-6afed66ec8bf tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:58.712062 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8874a0f5-6088-4a21-bff4-6afed66ec8bf tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:58.840407 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8874a0f5-6088-4a21-bff4-6afed66ec8bf tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:58.848035 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8874a0f5-6088-4a21-bff4-6afed66ec8bf tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1258 microversion: 2.1 time: 0.150844 Oct 24 13:33:58.849184 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 453/911] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:58 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:59.181110 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8d26bec1-feb8-470b-a9d3-46101cd0178e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:59.181712 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-8d26bec1-feb8-470b-a9d3-46101cd0178e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:59.187718 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8d26bec1-feb8-470b-a9d3-46101cd0178e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:59.188182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8d26bec1-feb8-470b-a9d3-46101cd0178e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:59.188642 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8d26bec1-feb8-470b-a9d3-46101cd0178e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:59.189311 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8d26bec1-feb8-470b-a9d3-46101cd0178e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:59.189749 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8d26bec1-feb8-470b-a9d3-46101cd0178e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:59.190158 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8d26bec1-feb8-470b-a9d3-46101cd0178e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:59.220130 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8d26bec1-feb8-470b-a9d3-46101cd0178e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:59.220623 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8d26bec1-feb8-470b-a9d3-46101cd0178e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:59.221089 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8d26bec1-feb8-470b-a9d3-46101cd0178e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:59.221517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.objects.instance [None req-8d26bec1-feb8-470b-a9d3-46101cd0178e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lazy-loading 'fault' on Instance uuid 47783c4e-2d71-46f8-a964-e268979915ac {{(pid=119145) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:33:59.264224 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-8d26bec1-feb8-470b-a9d3-46101cd0178e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:59.272541 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-8d26bec1-feb8-470b-a9d3-46101cd0178e tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1349 microversion: 2.1 time: 0.095366 Oct 24 13:33:59.273102 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 459/912] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:59 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:59.582505 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-cb912503-3426-4f17-b75e-b042e271b02c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:59.583640 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-cb912503-3426-4f17-b75e-b042e271b02c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:59.586695 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:33:59.590053 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb912503-3426-4f17-b75e-b042e271b02c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:59.590535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb912503-3426-4f17-b75e-b042e271b02c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:59.590970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb912503-3426-4f17-b75e-b042e271b02c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:59.591659 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb912503-3426-4f17-b75e-b042e271b02c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:59.592113 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb912503-3426-4f17-b75e-b042e271b02c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:59.592570 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb912503-3426-4f17-b75e-b042e271b02c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:59.724118 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-cb912503-3426-4f17-b75e-b042e271b02c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:33:59.731825 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-cb912503-3426-4f17-b75e-b042e271b02c tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 200 len: 1362 microversion: 2.1 time: 0.153334 Oct 24 13:33:59.732430 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 454/913] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:59 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:33:59.871238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a4716300-f630-472f-b1b0-3339c8795f18 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:59.871776 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a4716300-f630-472f-b1b0-3339c8795f18 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:33:59.878204 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a4716300-f630-472f-b1b0-3339c8795f18 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:59.878672 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a4716300-f630-472f-b1b0-3339c8795f18 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:59.879091 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a4716300-f630-472f-b1b0-3339c8795f18 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:59.879763 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a4716300-f630-472f-b1b0-3339c8795f18 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:59.880783 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a4716300-f630-472f-b1b0-3339c8795f18 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:59.881198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a4716300-f630-472f-b1b0-3339c8795f18 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:00.009464 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a4716300-f630-472f-b1b0-3339c8795f18 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:00.017548 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a4716300-f630-472f-b1b0-3339c8795f18 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1258 microversion: 2.1 time: 0.150127 Oct 24 13:34:00.018111 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 460/914] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:33:59 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:00.296263 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-155bda67-4680-43bc-a697-99a37d465cba tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:00.296889 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-155bda67-4680-43bc-a697-99a37d465cba tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:00.303382 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-155bda67-4680-43bc-a697-99a37d465cba tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:00.303859 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-155bda67-4680-43bc-a697-99a37d465cba tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:00.304309 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-155bda67-4680-43bc-a697-99a37d465cba tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:00.304986 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-155bda67-4680-43bc-a697-99a37d465cba tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:00.305435 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-155bda67-4680-43bc-a697-99a37d465cba tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:00.305849 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-155bda67-4680-43bc-a697-99a37d465cba tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:00.335283 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-155bda67-4680-43bc-a697-99a37d465cba tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:00.335726 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-155bda67-4680-43bc-a697-99a37d465cba tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:00.336198 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-155bda67-4680-43bc-a697-99a37d465cba tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:00.336661 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.objects.instance [None req-155bda67-4680-43bc-a697-99a37d465cba tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lazy-loading 'fault' on Instance uuid 47783c4e-2d71-46f8-a964-e268979915ac {{(pid=119146) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:34:00.376955 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-155bda67-4680-43bc-a697-99a37d465cba tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834b92eb61864d1b95e9f037379c2e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742dccd5a764a31ab1a228ead5cdab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:00.384667 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-155bda67-4680-43bc-a697-99a37d465cba tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 200 len: 1349 microversion: 2.1 time: 0.092046 Oct 24 13:34:00.385236 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 455/915] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:00 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:00.754913 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b8326b1d-9837-404a-96d7-ca984b345b5d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:00.755551 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b8326b1d-9837-404a-96d7-ca984b345b5d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:00.761625 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b8326b1d-9837-404a-96d7-ca984b345b5d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:00.762103 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b8326b1d-9837-404a-96d7-ca984b345b5d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:00.762533 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b8326b1d-9837-404a-96d7-ca984b345b5d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:00.763222 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b8326b1d-9837-404a-96d7-ca984b345b5d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:00.763668 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b8326b1d-9837-404a-96d7-ca984b345b5d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:00.764087 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b8326b1d-9837-404a-96d7-ca984b345b5d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:00.891718 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b8326b1d-9837-404a-96d7-ca984b345b5d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:00.900063 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b8326b1d-9837-404a-96d7-ca984b345b5d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 200 len: 1549 microversion: 2.1 time: 0.149043 Oct 24 13:34:00.900654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 461/916] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:00 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:00.922728 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-adabccf6-f7c2-408d-8b19-3ca4f34a96d7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:00.923343 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-adabccf6-f7c2-408d-8b19-3ca4f34a96d7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:00.929820 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-adabccf6-f7c2-408d-8b19-3ca4f34a96d7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:00.930294 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-adabccf6-f7c2-408d-8b19-3ca4f34a96d7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:00.930720 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-adabccf6-f7c2-408d-8b19-3ca4f34a96d7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:00.931396 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-adabccf6-f7c2-408d-8b19-3ca4f34a96d7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:00.931846 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-adabccf6-f7c2-408d-8b19-3ca4f34a96d7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:00.932261 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-adabccf6-f7c2-408d-8b19-3ca4f34a96d7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:01.009689 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-adabccf6-f7c2-408d-8b19-3ca4f34a96d7 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090831 Oct 24 13:34:01.010284 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 456/917] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 24 13:34:00 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:34:01.040094 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-dbc5d6fc-51f8-4f3f-828f-9d7d45d20ba6 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:01.040767 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-dbc5d6fc-51f8-4f3f-828f-9d7d45d20ba6 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:01.046661 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dbc5d6fc-51f8-4f3f-828f-9d7d45d20ba6 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:01.047129 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dbc5d6fc-51f8-4f3f-828f-9d7d45d20ba6 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:01.047583 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dbc5d6fc-51f8-4f3f-828f-9d7d45d20ba6 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:01.048256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dbc5d6fc-51f8-4f3f-828f-9d7d45d20ba6 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:01.048739 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dbc5d6fc-51f8-4f3f-828f-9d7d45d20ba6 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:01.049135 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dbc5d6fc-51f8-4f3f-828f-9d7d45d20ba6 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:01.332449 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-dbc5d6fc-51f8-4f3f-828f-9d7d45d20ba6 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:01.340557 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-dbc5d6fc-51f8-4f3f-828f-9d7d45d20ba6 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1258 microversion: 2.1 time: 0.304218 Oct 24 13:34:01.344524 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 462/918] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:01 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1258 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:01.408786 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a459df13-9782-4981-b3b3-3302c5e51bd5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:01.409599 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a459df13-9782-4981-b3b3-3302c5e51bd5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] [instance: 47783c4e-2d71-46f8-a964-e268979915ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:01.416588 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a459df13-9782-4981-b3b3-3302c5e51bd5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:01.417080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a459df13-9782-4981-b3b3-3302c5e51bd5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:01.417519 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a459df13-9782-4981-b3b3-3302c5e51bd5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:01.418250 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a459df13-9782-4981-b3b3-3302c5e51bd5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:01.418875 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a459df13-9782-4981-b3b3-3302c5e51bd5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:01.419330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a459df13-9782-4981-b3b3-3302c5e51bd5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:01.434390 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-a459df13-9782-4981-b3b3-3302c5e51bd5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] HTTP exception thrown: Instance 47783c4e-2d71-46f8-a964-e268979915ac could not be found. Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a459df13-9782-4981-b3b3-3302c5e51bd5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Request method failure captured: Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac HTTP/1.1 Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpLi38QCGBRqbtn8ADP_HhwHjRX2eOi1H1OnjwI9Zy9YOACMk3zGJaCNpASfDOhGkz2TFSw5oH5Vn5TCZOZOoLCjL-8TXUddygwFb-axMT7fDsEMbJB14Ahd8nnLv-_2xH1Hcg76_FPfYMJtE8nksILgNhof7OF1ix4izNJa-CUb1vE Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 1742dccd5a764a31ab1a228ead5cdab9 Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-TestMinimumBasicScenario-1479834024 Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:34:01.436144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:34:01.444051 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1742dccd5a764a31ab1a228ead5cdab9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1742dccd5a764a31ab1a228ead5cdab9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1742dccd5a764a31ab1a228ead5cdab9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1742dccd5a764a31ab1a228ead5cdab9"}]}] Oct 24 13:34:01.444051 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-TestMinimumBasicScenario-1479834024 Oct 24 13:34:01.444051 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 1742dccd5a764a31ab1a228ead5cdab9 Oct 24 13:34:01.444051 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1479834024 Oct 24 13:34:01.444051 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-TestMinimumBasicScenario-1479834024-project Oct 24 13:34:01.444051 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:34:01.444051 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:34:01.444051 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 834b92eb61864d1b95e9f037379c2e13 Oct 24 13:34:01.444051 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-TestMinimumBasicScenario-1479834024-project Oct 24 13:34:01.444051 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:34:01.444051 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Instance 47783c4e-2d71-46f8-a964-e268979915ac could not be found. Oct 24 13:34:01.444051 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': '47783c4e-2d71-46f8-a964-e268979915ac'} Oct 24 13:34:01.445083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:34:01.445083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:34:01.445083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:34:01.445083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:34:01.445083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:34:01.445083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:34:01.445083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:34:01.445083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:34:01.445083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:34:01.445083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:34:01.445083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47783c4e-2d71-46f8-a964-e268979915ac could not be found. Oct 24 13:34:01.445083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:34:01.445083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:34:01.445083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:34:01.445083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:34:01.445083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:34:01.445083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:34:01.445083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:34:01.445083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:34:01.445083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:34:01.446908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:34:01.446908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:34:01.446908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:34:01.446908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:34:01.446908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:34:01.446908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:34:01.446908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:34:01.446908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47783c4e-2d71-46f8-a964-e268979915ac could not be found. Oct 24 13:34:01.446908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:34:01.446908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:34:01.446908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:34:01.446908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:34:01.446908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:34:01.446908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:34:01.446908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:34:01.446908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:34:01.446908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47783c4e-2d71-46f8-a964-e268979915ac could not be found. Oct 24 13:34:01.446908 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:34:01.448382 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a459df13-9782-4981-b3b3-3302c5e51bd5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Returning 404 to user: Instance 47783c4e-2d71-46f8-a964-e268979915ac could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:34:01.448382 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a459df13-9782-4981-b3b3-3302c5e51bd5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac" status: 404 len: 111 microversion: 2.1 time: 0.032815 Oct 24 13:34:01.448382 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 457/919] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:01 2022] GET /compute/v2.1/servers/47783c4e-2d71-46f8-a964-e268979915ac => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:34:01.448700 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-79fa1cda-d881-4fca-9365-25b0df59a5e5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] Calling method '.version_select at 0x7f17ab8a5670>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:01.456415 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:01.521319 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-79fa1cda-d881-4fca-9365-25b0df59a5e5 tempest-TestMinimumBasicScenario-1479834024 tempest-TestMinimumBasicScenario-1479834024-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1950010657" status: 202 len: 0 microversion: 2.1 time: 0.077801 Oct 24 13:34:01.521903 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 463/920] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 24 13:34:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1950010657 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:34:02.276817 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-ef296ac3-aced-4715-b8be-037050acd9de req-da7f396b-77b3-4129-a1d6-5203df6ab307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "937175c3-4262-4fe8-acfc-69bd009df2ac", "tag": "28395180-00b3-4e86-b35a-bac15da8261a"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:34:02.287145 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-ef296ac3-aced-4715-b8be-037050acd9de req-da7f396b-77b3-4129-a1d6-5203df6ab307 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:02.287643 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-ef296ac3-aced-4715-b8be-037050acd9de req-da7f396b-77b3-4129-a1d6-5203df6ab307 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:02.288069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-ef296ac3-aced-4715-b8be-037050acd9de req-da7f396b-77b3-4129-a1d6-5203df6ab307 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:02.302616 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-ef296ac3-aced-4715-b8be-037050acd9de req-da7f396b-77b3-4129-a1d6-5203df6ab307 service nova] Creating event network-changed:28395180-00b3-4e86-b35a-bac15da8261a for instance 937175c3-4262-4fe8-acfc-69bd009df2ac on hv-cinder-86249 Oct 24 13:34:02.307951 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-ef296ac3-aced-4715-b8be-037050acd9de req-da7f396b-77b3-4129-a1d6-5203df6ab307 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036251 Oct 24 13:34:02.308397 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 458/921] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:34:02.363542 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0a8df481-3925-4a51-89c2-d65d4281688b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:02.364209 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0a8df481-3925-4a51-89c2-d65d4281688b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:02.372744 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0a8df481-3925-4a51-89c2-d65d4281688b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:02.378674 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0a8df481-3925-4a51-89c2-d65d4281688b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:02.378674 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0a8df481-3925-4a51-89c2-d65d4281688b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:02.378674 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0a8df481-3925-4a51-89c2-d65d4281688b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:02.378674 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0a8df481-3925-4a51-89c2-d65d4281688b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:02.379064 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0a8df481-3925-4a51-89c2-d65d4281688b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:02.519472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0a8df481-3925-4a51-89c2-d65d4281688b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:02.527340 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0a8df481-3925-4a51-89c2-d65d4281688b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1258 microversion: 2.1 time: 0.168066 Oct 24 13:34:02.527908 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 464/922] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:02 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:03.552977 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-af6cdc2c-68bf-45cb-b42d-80788b61c91c tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:03.553591 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-af6cdc2c-68bf-45cb-b42d-80788b61c91c tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:03.560602 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-af6cdc2c-68bf-45cb-b42d-80788b61c91c tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:03.561088 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-af6cdc2c-68bf-45cb-b42d-80788b61c91c tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:03.561695 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-af6cdc2c-68bf-45cb-b42d-80788b61c91c tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:03.562673 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-af6cdc2c-68bf-45cb-b42d-80788b61c91c tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:03.563292 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-af6cdc2c-68bf-45cb-b42d-80788b61c91c tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:03.563891 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-af6cdc2c-68bf-45cb-b42d-80788b61c91c tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:03.781124 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-af6cdc2c-68bf-45cb-b42d-80788b61c91c tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:03.789770 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-af6cdc2c-68bf-45cb-b42d-80788b61c91c tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1258 microversion: 2.1 time: 0.242325 Oct 24 13:34:03.790462 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 459/923] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:03 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1258 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:04.813564 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-862b22b3-e4ee-4279-82b2-66af9986e4ea tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:04.814881 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-862b22b3-e4ee-4279-82b2-66af9986e4ea tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:04.824823 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-862b22b3-e4ee-4279-82b2-66af9986e4ea tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:04.825910 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-862b22b3-e4ee-4279-82b2-66af9986e4ea tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:04.826565 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-862b22b3-e4ee-4279-82b2-66af9986e4ea tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:04.827757 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-862b22b3-e4ee-4279-82b2-66af9986e4ea tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:04.828568 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-862b22b3-e4ee-4279-82b2-66af9986e4ea tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:04.829205 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-862b22b3-e4ee-4279-82b2-66af9986e4ea tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:05.190930 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-862b22b3-e4ee-4279-82b2-66af9986e4ea tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:05.206259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-862b22b3-e4ee-4279-82b2-66af9986e4ea tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1258 microversion: 2.1 time: 0.396082 Oct 24 13:34:05.217735 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 465/924] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:04 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1258 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:34:06.231822 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-2d462283-608f-4666-aa73-63f4e474467c tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:06.232522 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-2d462283-608f-4666-aa73-63f4e474467c tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:06.240052 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2d462283-608f-4666-aa73-63f4e474467c tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:06.240371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2d462283-608f-4666-aa73-63f4e474467c tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:06.240698 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2d462283-608f-4666-aa73-63f4e474467c tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:06.241391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2d462283-608f-4666-aa73-63f4e474467c tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:06.241838 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2d462283-608f-4666-aa73-63f4e474467c tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:06.242254 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2d462283-608f-4666-aa73-63f4e474467c tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:06.381719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-2d462283-608f-4666-aa73-63f4e474467c tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:06.389959 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-2d462283-608f-4666-aa73-63f4e474467c tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1258 microversion: 2.1 time: 0.162220 Oct 24 13:34:06.390622 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 460/925] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:06 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:07.418799 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-1f1aa159-d868-4c1f-a200-4e9a2f8ec358 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:07.419442 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-1f1aa159-d868-4c1f-a200-4e9a2f8ec358 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:07.426228 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1f1aa159-d868-4c1f-a200-4e9a2f8ec358 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:07.427215 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1f1aa159-d868-4c1f-a200-4e9a2f8ec358 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:07.427640 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1f1aa159-d868-4c1f-a200-4e9a2f8ec358 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:07.428351 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1f1aa159-d868-4c1f-a200-4e9a2f8ec358 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:07.428795 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1f1aa159-d868-4c1f-a200-4e9a2f8ec358 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:07.429211 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1f1aa159-d868-4c1f-a200-4e9a2f8ec358 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:07.568416 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1f1aa159-d868-4c1f-a200-4e9a2f8ec358 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:07.571801 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:07.576666 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-1f1aa159-d868-4c1f-a200-4e9a2f8ec358 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1258 microversion: 2.1 time: 0.161699 Oct 24 13:34:07.577230 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 466/926] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:07 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:07.983856 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-e1f119d3-06d1-4d7d-a3b2-6166b3911380 req-32b1b157-afc2-473b-a31c-b8f5f3e7921c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25ad1362-6db1-48be-8ddb-3fa0b0f78404", "name": "network-vif-plugged", "status": "completed", "tag": "70dbb5cd-19fd-4c0e-b47a-955a76e67b6b"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:34:07.994905 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-e1f119d3-06d1-4d7d-a3b2-6166b3911380 req-32b1b157-afc2-473b-a31c-b8f5f3e7921c service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:07.995613 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-e1f119d3-06d1-4d7d-a3b2-6166b3911380 req-32b1b157-afc2-473b-a31c-b8f5f3e7921c service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:07.996043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-e1f119d3-06d1-4d7d-a3b2-6166b3911380 req-32b1b157-afc2-473b-a31c-b8f5f3e7921c service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:08.007317 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-e1f119d3-06d1-4d7d-a3b2-6166b3911380 req-32b1b157-afc2-473b-a31c-b8f5f3e7921c service nova] Creating event network-vif-plugged:70dbb5cd-19fd-4c0e-b47a-955a76e67b6b for instance 25ad1362-6db1-48be-8ddb-3fa0b0f78404 on hv-cinder-86249 Oct 24 13:34:08.012225 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-e1f119d3-06d1-4d7d-a3b2-6166b3911380 req-32b1b157-afc2-473b-a31c-b8f5f3e7921c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032173 Oct 24 13:34:08.013024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 461/927] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:34:08.604087 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-37ab50dd-ba17-49f4-a06b-003868059a43 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:08.605148 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-37ab50dd-ba17-49f4-a06b-003868059a43 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:08.615627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37ab50dd-ba17-49f4-a06b-003868059a43 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:08.616396 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37ab50dd-ba17-49f4-a06b-003868059a43 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:08.616978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37ab50dd-ba17-49f4-a06b-003868059a43 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:08.617874 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37ab50dd-ba17-49f4-a06b-003868059a43 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:08.618470 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37ab50dd-ba17-49f4-a06b-003868059a43 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:08.619039 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37ab50dd-ba17-49f4-a06b-003868059a43 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:08.819292 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-37ab50dd-ba17-49f4-a06b-003868059a43 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:08.828179 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-37ab50dd-ba17-49f4-a06b-003868059a43 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1258 microversion: 2.1 time: 0.232366 Oct 24 13:34:08.843584 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 467/928] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:08 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1258 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:09.853471 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-041d9655-dea0-4c24-b6f7-398bd0c1b6d6 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:09.854229 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-041d9655-dea0-4c24-b6f7-398bd0c1b6d6 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:09.860196 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-041d9655-dea0-4c24-b6f7-398bd0c1b6d6 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:09.860709 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-041d9655-dea0-4c24-b6f7-398bd0c1b6d6 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:09.861138 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-041d9655-dea0-4c24-b6f7-398bd0c1b6d6 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:09.861820 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-041d9655-dea0-4c24-b6f7-398bd0c1b6d6 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:09.862264 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-041d9655-dea0-4c24-b6f7-398bd0c1b6d6 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:09.862678 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-041d9655-dea0-4c24-b6f7-398bd0c1b6d6 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:09.939321 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-86b80db5-f3db-4b61-b0f7-63adc9f96170 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:09.939957 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-86b80db5-f3db-4b61-b0f7-63adc9f96170 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:09.946104 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-86b80db5-f3db-4b61-b0f7-63adc9f96170 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:09.946575 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-86b80db5-f3db-4b61-b0f7-63adc9f96170 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:09.946997 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-86b80db5-f3db-4b61-b0f7-63adc9f96170 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:09.947699 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-86b80db5-f3db-4b61-b0f7-63adc9f96170 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:09.948173 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-86b80db5-f3db-4b61-b0f7-63adc9f96170 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:09.948594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-86b80db5-f3db-4b61-b0f7-63adc9f96170 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:10.015291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-041d9655-dea0-4c24-b6f7-398bd0c1b6d6 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:10.025140 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-041d9655-dea0-4c24-b6f7-398bd0c1b6d6 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1258 microversion: 2.1 time: 0.176673 Oct 24 13:34:10.026379 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 462/929] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:09 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:10.055507 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.objects.instance [None req-86b80db5-f3db-4b61-b0f7-63adc9f96170 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lazy-loading 'services' on Instance uuid bb595949-cb79-47e4-b760-6e9dfd97b222 {{(pid=119145) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:34:10.304224 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-86b80db5-f3db-4b61-b0f7-63adc9f96170 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/os-volume_attachments/0b38a74e-70d4-4d07-a5f5-6b75e3238bbe" status: 202 len: 0 microversion: 2.1 time: 0.368567 Oct 24 13:34:10.309141 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 468/930] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 24 13:34:09 2022] DELETE /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/os-volume_attachments/0b38a74e-70d4-4d07-a5f5-6b75e3238bbe => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 13:34:10.314275 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9ab6bc94-c9ff-4148-affc-1deddd5a7440 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:10.316861 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-9ab6bc94-c9ff-4148-affc-1deddd5a7440 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:10.334592 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9ab6bc94-c9ff-4148-affc-1deddd5a7440 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:10.337855 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9ab6bc94-c9ff-4148-affc-1deddd5a7440 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:10.339768 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9ab6bc94-c9ff-4148-affc-1deddd5a7440 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:10.344665 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9ab6bc94-c9ff-4148-affc-1deddd5a7440 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:10.344665 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9ab6bc94-c9ff-4148-affc-1deddd5a7440 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:10.344665 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9ab6bc94-c9ff-4148-affc-1deddd5a7440 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:10.388223 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9ab6bc94-c9ff-4148-affc-1deddd5a7440 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078438 Oct 24 13:34:10.388866 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 463/931] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 24 13:34:10 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:34:11.051898 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-84780283-e241-4759-8be2-754b14e44456 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:11.053225 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-84780283-e241-4759-8be2-754b14e44456 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:11.061153 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-84780283-e241-4759-8be2-754b14e44456 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:11.061634 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-84780283-e241-4759-8be2-754b14e44456 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:11.062188 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-84780283-e241-4759-8be2-754b14e44456 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:11.062832 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-84780283-e241-4759-8be2-754b14e44456 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:11.063274 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-84780283-e241-4759-8be2-754b14e44456 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:11.063685 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-84780283-e241-4759-8be2-754b14e44456 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:11.201260 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-84780283-e241-4759-8be2-754b14e44456 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:11.209594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-84780283-e241-4759-8be2-754b14e44456 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1442 microversion: 2.1 time: 0.162685 Oct 24 13:34:11.212154 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 469/932] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:11 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1442 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:11.233329 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-0c9750d5-e99a-41aa-8206-0eab9b73c0f4 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:11.234561 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-0c9750d5-e99a-41aa-8206-0eab9b73c0f4 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:11.241406 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0c9750d5-e99a-41aa-8206-0eab9b73c0f4 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:11.252365 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0c9750d5-e99a-41aa-8206-0eab9b73c0f4 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:11.252365 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0c9750d5-e99a-41aa-8206-0eab9b73c0f4 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:11.252365 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0c9750d5-e99a-41aa-8206-0eab9b73c0f4 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:11.252365 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0c9750d5-e99a-41aa-8206-0eab9b73c0f4 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:11.252734 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0c9750d5-e99a-41aa-8206-0eab9b73c0f4 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:11.389229 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-0c9750d5-e99a-41aa-8206-0eab9b73c0f4 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:11.400654 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-0c9750d5-e99a-41aa-8206-0eab9b73c0f4 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1442 microversion: 2.1 time: 0.170847 Oct 24 13:34:11.403255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 464/933] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:11 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1442 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:11.403402 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-37e46432-8890-49b6-82fd-5a2de7f53eb0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:11.405171 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-37e46432-8890-49b6-82fd-5a2de7f53eb0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:11.411872 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37e46432-8890-49b6-82fd-5a2de7f53eb0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:11.412372 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37e46432-8890-49b6-82fd-5a2de7f53eb0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:11.413605 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37e46432-8890-49b6-82fd-5a2de7f53eb0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:11.414621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37e46432-8890-49b6-82fd-5a2de7f53eb0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:11.415557 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37e46432-8890-49b6-82fd-5a2de7f53eb0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:11.416216 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37e46432-8890-49b6-82fd-5a2de7f53eb0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:11.485437 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-37e46432-8890-49b6-82fd-5a2de7f53eb0 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087414 Oct 24 13:34:11.485997 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 470/934] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 24 13:34:11 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:34:12.498765 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-d3aaaa36-ffb5-4b61-b420-9404ba3102cd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:12.501828 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-d3aaaa36-ffb5-4b61-b420-9404ba3102cd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:12.508324 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d3aaaa36-ffb5-4b61-b420-9404ba3102cd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:12.508753 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d3aaaa36-ffb5-4b61-b420-9404ba3102cd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:12.509180 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d3aaaa36-ffb5-4b61-b420-9404ba3102cd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:12.510174 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d3aaaa36-ffb5-4b61-b420-9404ba3102cd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:12.510628 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d3aaaa36-ffb5-4b61-b420-9404ba3102cd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:12.511210 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d3aaaa36-ffb5-4b61-b420-9404ba3102cd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:12.515536 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=100 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:12.543155 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-d3aaaa36-ffb5-4b61-b420-9404ba3102cd tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049006 Oct 24 13:34:12.543727 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 465/935] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 24 13:34:12 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:34:12.631442 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f727ee33-25bf-4140-b1f2-345e3c98d310 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:12.631991 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f727ee33-25bf-4140-b1f2-345e3c98d310 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:12.638199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f727ee33-25bf-4140-b1f2-345e3c98d310 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:12.638679 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f727ee33-25bf-4140-b1f2-345e3c98d310 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:12.639110 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f727ee33-25bf-4140-b1f2-345e3c98d310 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:12.641210 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f727ee33-25bf-4140-b1f2-345e3c98d310 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:12.641210 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f727ee33-25bf-4140-b1f2-345e3c98d310 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:12.641210 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f727ee33-25bf-4140-b1f2-345e3c98d310 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:12.666540 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f727ee33-25bf-4140-b1f2-345e3c98d310 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Going to try to terminate instance {{(pid=119145) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:34:12.971413 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f727ee33-25bf-4140-b1f2-345e3c98d310 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 204 len: 0 microversion: 2.1 time: 0.343530 Oct 24 13:34:12.971998 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 471/936] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:34:12 2022] DELETE /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:34:12.979934 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-53e0d4f9-a973-4349-b105-9b6408f8d804 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:12.980654 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-53e0d4f9-a973-4349-b105-9b6408f8d804 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:12.986444 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53e0d4f9-a973-4349-b105-9b6408f8d804 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:12.986926 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53e0d4f9-a973-4349-b105-9b6408f8d804 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:12.987369 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53e0d4f9-a973-4349-b105-9b6408f8d804 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:12.988057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53e0d4f9-a973-4349-b105-9b6408f8d804 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:12.988552 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53e0d4f9-a973-4349-b105-9b6408f8d804 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:12.988976 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53e0d4f9-a973-4349-b105-9b6408f8d804 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:13.132587 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-53e0d4f9-a973-4349-b105-9b6408f8d804 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:13.142820 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-53e0d4f9-a973-4349-b105-9b6408f8d804 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1686 microversion: 2.1 time: 0.166593 Oct 24 13:34:13.143822 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 466/937] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:12 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:13.633609 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-b41ca261-e511-45d7-aa31-16e698c9a4b4 req-d3eb59ce-d8c3-49a5-9e62-fdfba45670a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25ad1362-6db1-48be-8ddb-3fa0b0f78404", "tag": "70dbb5cd-19fd-4c0e-b47a-955a76e67b6b"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:34:13.648942 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-b41ca261-e511-45d7-aa31-16e698c9a4b4 req-d3eb59ce-d8c3-49a5-9e62-fdfba45670a7 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:13.649659 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-b41ca261-e511-45d7-aa31-16e698c9a4b4 req-d3eb59ce-d8c3-49a5-9e62-fdfba45670a7 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:13.650286 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-b41ca261-e511-45d7-aa31-16e698c9a4b4 req-d3eb59ce-d8c3-49a5-9e62-fdfba45670a7 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:13.666944 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-b41ca261-e511-45d7-aa31-16e698c9a4b4 req-d3eb59ce-d8c3-49a5-9e62-fdfba45670a7 service nova] Creating event network-changed:70dbb5cd-19fd-4c0e-b47a-955a76e67b6b for instance 25ad1362-6db1-48be-8ddb-3fa0b0f78404 on hv-cinder-86249 Oct 24 13:34:13.672486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-b41ca261-e511-45d7-aa31-16e698c9a4b4 req-d3eb59ce-d8c3-49a5-9e62-fdfba45670a7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048895 Oct 24 13:34:13.673768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 472/938] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:34:14.169006 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e795b69e-df85-4b6d-9bc1-d9abaf5ca480 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:14.170333 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e795b69e-df85-4b6d-9bc1-d9abaf5ca480 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:14.177117 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e795b69e-df85-4b6d-9bc1-d9abaf5ca480 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:14.177913 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e795b69e-df85-4b6d-9bc1-d9abaf5ca480 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:14.178356 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e795b69e-df85-4b6d-9bc1-d9abaf5ca480 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:14.179044 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e795b69e-df85-4b6d-9bc1-d9abaf5ca480 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:14.179694 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e795b69e-df85-4b6d-9bc1-d9abaf5ca480 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:14.180536 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e795b69e-df85-4b6d-9bc1-d9abaf5ca480 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:14.338935 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e795b69e-df85-4b6d-9bc1-d9abaf5ca480 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:14.347810 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e795b69e-df85-4b6d-9bc1-d9abaf5ca480 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1686 microversion: 2.1 time: 0.184454 Oct 24 13:34:14.352312 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 467/939] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:14 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1686 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:15.373798 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c43c1711-ee6c-4d64-883a-0ed1e8a8c683 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:15.374476 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-c43c1711-ee6c-4d64-883a-0ed1e8a8c683 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:15.383301 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c43c1711-ee6c-4d64-883a-0ed1e8a8c683 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:15.384035 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c43c1711-ee6c-4d64-883a-0ed1e8a8c683 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:15.384487 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c43c1711-ee6c-4d64-883a-0ed1e8a8c683 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:15.385391 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c43c1711-ee6c-4d64-883a-0ed1e8a8c683 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:15.386042 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c43c1711-ee6c-4d64-883a-0ed1e8a8c683 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:15.386755 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c43c1711-ee6c-4d64-883a-0ed1e8a8c683 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:15.851999 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c43c1711-ee6c-4d64-883a-0ed1e8a8c683 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:15.860594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-c43c1711-ee6c-4d64-883a-0ed1e8a8c683 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1686 microversion: 2.1 time: 0.491403 Oct 24 13:34:15.861393 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 473/940] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:15 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1686 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:16.888738 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8d5fa5ce-8a84-4d09-9a36-22f6c7459a35 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:16.890219 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8d5fa5ce-8a84-4d09-9a36-22f6c7459a35 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:16.902906 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8d5fa5ce-8a84-4d09-9a36-22f6c7459a35 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:16.903561 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8d5fa5ce-8a84-4d09-9a36-22f6c7459a35 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:16.904001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8d5fa5ce-8a84-4d09-9a36-22f6c7459a35 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:16.905663 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8d5fa5ce-8a84-4d09-9a36-22f6c7459a35 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:16.906413 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8d5fa5ce-8a84-4d09-9a36-22f6c7459a35 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:16.908632 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8d5fa5ce-8a84-4d09-9a36-22f6c7459a35 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:16.980657 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8d5fa5ce-8a84-4d09-9a36-22f6c7459a35 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:16.992812 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8d5fa5ce-8a84-4d09-9a36-22f6c7459a35 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1618 microversion: 2.1 time: 0.111560 Oct 24 13:34:16.994578 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 468/941] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:16 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1618 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:17.199152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-8bda9429-bd05-43d6-b310-eba984081916 req-5b02e6ec-1c3d-460c-8220-c2a78e40b2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb595949-cb79-47e4-b760-6e9dfd97b222", "name": "network-vif-deleted", "tag": "c2e4dc49-a4c3-4b4e-97ea-3d9c9f960383"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:34:17.217439 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-8bda9429-bd05-43d6-b310-eba984081916 req-5b02e6ec-1c3d-460c-8220-c2a78e40b2a1 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:17.217915 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-8bda9429-bd05-43d6-b310-eba984081916 req-5b02e6ec-1c3d-460c-8220-c2a78e40b2a1 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:17.218339 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-8bda9429-bd05-43d6-b310-eba984081916 req-5b02e6ec-1c3d-460c-8220-c2a78e40b2a1 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:17.240652 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-8bda9429-bd05-43d6-b310-eba984081916 req-5b02e6ec-1c3d-460c-8220-c2a78e40b2a1 service nova] Creating event network-vif-deleted:c2e4dc49-a4c3-4b4e-97ea-3d9c9f960383 for instance bb595949-cb79-47e4-b760-6e9dfd97b222 on hv-cinder-86249 Oct 24 13:34:17.249746 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-8bda9429-bd05-43d6-b310-eba984081916 req-5b02e6ec-1c3d-460c-8220-c2a78e40b2a1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060899 Oct 24 13:34:17.255514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 474/942] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:34:18.019996 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-eded05d0-efcf-4520-a7f6-c5d50467b488 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:18.021360 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-eded05d0-efcf-4520-a7f6-c5d50467b488 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:18.030394 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eded05d0-efcf-4520-a7f6-c5d50467b488 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:18.030875 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eded05d0-efcf-4520-a7f6-c5d50467b488 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:18.031305 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eded05d0-efcf-4520-a7f6-c5d50467b488 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:18.032058 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eded05d0-efcf-4520-a7f6-c5d50467b488 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:18.032538 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eded05d0-efcf-4520-a7f6-c5d50467b488 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:18.032956 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eded05d0-efcf-4520-a7f6-c5d50467b488 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:18.088432 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eded05d0-efcf-4520-a7f6-c5d50467b488 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:18.089279 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eded05d0-efcf-4520-a7f6-c5d50467b488 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:18.089927 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eded05d0-efcf-4520-a7f6-c5d50467b488 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:18.090594 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.objects.instance [None req-eded05d0-efcf-4520-a7f6-c5d50467b488 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lazy-loading 'fault' on Instance uuid bb595949-cb79-47e4-b760-6e9dfd97b222 {{(pid=119146) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:34:18.154891 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-eded05d0-efcf-4520-a7f6-c5d50467b488 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:18.165635 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-eded05d0-efcf-4520-a7f6-c5d50467b488 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 200 len: 1334 microversion: 2.1 time: 0.150553 Oct 24 13:34:18.166796 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 469/943] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:18 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 1334 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:19.200057 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9ca4e615-8d3c-48ec-93c2-f8acbc96e285 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:19.201682 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9ca4e615-8d3c-48ec-93c2-f8acbc96e285 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: bb595949-cb79-47e4-b760-6e9dfd97b222] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:19.210345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ca4e615-8d3c-48ec-93c2-f8acbc96e285 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:19.211067 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ca4e615-8d3c-48ec-93c2-f8acbc96e285 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:19.211772 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ca4e615-8d3c-48ec-93c2-f8acbc96e285 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:19.212943 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ca4e615-8d3c-48ec-93c2-f8acbc96e285 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:19.213550 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ca4e615-8d3c-48ec-93c2-f8acbc96e285 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:19.214250 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ca4e615-8d3c-48ec-93c2-f8acbc96e285 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:19.234681 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-9ca4e615-8d3c-48ec-93c2-f8acbc96e285 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] HTTP exception thrown: Instance bb595949-cb79-47e4-b760-6e9dfd97b222 could not be found. Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9ca4e615-8d3c-48ec-93c2-f8acbc96e285 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Request method failure captured: Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 HTTP/1.1 Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpJKIq5Rg50YSGQIjea3FRN8mTaXpsN5dA41WiaGbVh9lcQUtvdp2bBedjxQrf6lA7EHcL6QKUXInDPdjkl_Ihu9evaGWoTz8qUtj4HiB1zTeWk0JDMERKf8vFbcZFV6NCEsUhI2fpefVy7T0gdhukP3dZAyqmypjxu54EdjX60vHfw Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: 986792b802264c748e4614c4d2a17680 Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-440406220 Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:34:19.236723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:34:19.238313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_986792b802264c748e4614c4d2a17680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/986792b802264c748e4614c4d2a17680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/986792b802264c748e4614c4d2a17680"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/986792b802264c748e4614c4d2a17680"}]}] Oct 24 13:34:19.238313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-ServerRescueNegativeTestJSON-440406220 Oct 24 13:34:19.238313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: 986792b802264c748e4614c4d2a17680 Oct 24 13:34:19.238313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-440406220 Oct 24 13:34:19.238313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-ServerRescueNegativeTestJSON-440406220-project Oct 24 13:34:19.238313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:34:19.238313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:34:19.238313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 633c6c68e15f4be9a7289d15cac9de43 Oct 24 13:34:19.238313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-ServerRescueNegativeTestJSON-440406220-project Oct 24 13:34:19.238313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:34:19.238313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance bb595949-cb79-47e4-b760-6e9dfd97b222 could not be found. Oct 24 13:34:19.238313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': 'bb595949-cb79-47e4-b760-6e9dfd97b222'} Oct 24 13:34:19.239238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:34:19.239238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:34:19.239238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:34:19.239238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:34:19.239238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:34:19.239238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:34:19.239238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:34:19.239238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:34:19.239238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:34:19.239238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:34:19.239238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb595949-cb79-47e4-b760-6e9dfd97b222 could not be found. Oct 24 13:34:19.239238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:34:19.239238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:34:19.239238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:34:19.239238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:34:19.239238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:34:19.239238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:34:19.239238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:34:19.239238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:34:19.239238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:34:19.240702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:34:19.240702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:34:19.240702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:34:19.240702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:34:19.240702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:34:19.240702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:34:19.240702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:34:19.240702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb595949-cb79-47e4-b760-6e9dfd97b222 could not be found. Oct 24 13:34:19.240702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:34:19.240702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:34:19.240702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:34:19.240702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:34:19.240702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:34:19.240702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:34:19.240702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:34:19.240702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:34:19.240702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb595949-cb79-47e4-b760-6e9dfd97b222 could not be found. Oct 24 13:34:19.240702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:34:19.242819 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9ca4e615-8d3c-48ec-93c2-f8acbc96e285 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Returning 404 to user: Instance bb595949-cb79-47e4-b760-6e9dfd97b222 could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:34:19.243656 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9ca4e615-8d3c-48ec-93c2-f8acbc96e285 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222" status: 404 len: 111 microversion: 2.1 time: 0.054990 Oct 24 13:34:19.247515 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 475/944] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:19 2022] GET /compute/v2.1/servers/bb595949-cb79-47e4-b760-6e9dfd97b222 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:34:19.252537 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f2d9b10f-78d1-4bc6-aac7-c08a63f4b6f2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '.version_select at 0x7f17a8213ee0>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:19.326697 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f2d9b10f-78d1-4bc6-aac7-c08a63f4b6f2 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2049818280" status: 202 len: 0 microversion: 2.1 time: 0.076897 Oct 24 13:34:19.329914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 470/945] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 24 13:34:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2049818280 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:34:23.041311 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-213cda25-99bc-490b-80af-8e637ee44280 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:23.042431 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-213cda25-99bc-490b-80af-8e637ee44280 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:23.053503 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-213cda25-99bc-490b-80af-8e637ee44280 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:23.056479 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-213cda25-99bc-490b-80af-8e637ee44280 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:23.061400 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-213cda25-99bc-490b-80af-8e637ee44280 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:23.061400 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-213cda25-99bc-490b-80af-8e637ee44280 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:23.061400 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-213cda25-99bc-490b-80af-8e637ee44280 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:23.061400 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-213cda25-99bc-490b-80af-8e637ee44280 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:23.104575 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-213cda25-99bc-490b-80af-8e637ee44280 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Going to try to terminate instance {{(pid=119145) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:34:23.366802 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-213cda25-99bc-490b-80af-8e637ee44280 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 204 len: 0 microversion: 2.1 time: 0.329266 Oct 24 13:34:23.367799 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 476/946] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:34:23 2022] DELETE /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:34:23.377218 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-63ae1b58-a8b5-4b19-bae8-3e4b70bc812a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:23.377902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-63ae1b58-a8b5-4b19-bae8-3e4b70bc812a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:23.384237 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-63ae1b58-a8b5-4b19-bae8-3e4b70bc812a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:23.385599 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-63ae1b58-a8b5-4b19-bae8-3e4b70bc812a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:23.386257 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-63ae1b58-a8b5-4b19-bae8-3e4b70bc812a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:23.387181 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-63ae1b58-a8b5-4b19-bae8-3e4b70bc812a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:23.387705 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-63ae1b58-a8b5-4b19-bae8-3e4b70bc812a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:23.388193 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-63ae1b58-a8b5-4b19-bae8-3e4b70bc812a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:23.536920 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-63ae1b58-a8b5-4b19-bae8-3e4b70bc812a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:23.548500 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-63ae1b58-a8b5-4b19-bae8-3e4b70bc812a tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1507 microversion: 2.1 time: 0.176203 Oct 24 13:34:23.549490 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 471/947] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:23 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:24.578406 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-21280849-4fe6-47f0-a7ba-732e58c7130f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:24.579115 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-21280849-4fe6-47f0-a7ba-732e58c7130f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:24.586722 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-21280849-4fe6-47f0-a7ba-732e58c7130f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:24.587412 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-21280849-4fe6-47f0-a7ba-732e58c7130f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:24.588918 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-21280849-4fe6-47f0-a7ba-732e58c7130f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:24.589381 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-21280849-4fe6-47f0-a7ba-732e58c7130f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:24.589986 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-21280849-4fe6-47f0-a7ba-732e58c7130f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:24.590967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-21280849-4fe6-47f0-a7ba-732e58c7130f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:24.927965 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-8f1ec466-fe14-4460-826a-e3e00fa7b7c7 req-8771b8f9-1584-48f9-bf7b-af0edf9cbac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de4c382-e12d-4068-96c2-58d44e5265db", "name": "network-vif-deleted", "tag": "c7b02435-39c6-46a8-a356-81bef309201a"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:34:24.947083 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-8f1ec466-fe14-4460-826a-e3e00fa7b7c7 req-8771b8f9-1584-48f9-bf7b-af0edf9cbac3 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:24.949200 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-8f1ec466-fe14-4460-826a-e3e00fa7b7c7 req-8771b8f9-1584-48f9-bf7b-af0edf9cbac3 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:24.949810 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-8f1ec466-fe14-4460-826a-e3e00fa7b7c7 req-8771b8f9-1584-48f9-bf7b-af0edf9cbac3 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:24.961983 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-21280849-4fe6-47f0-a7ba-732e58c7130f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:24.971747 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-21280849-4fe6-47f0-a7ba-732e58c7130f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1507 microversion: 2.1 time: 0.398596 Oct 24 13:34:24.982444 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 477/948] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:24 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1507 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:24.986983 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-8f1ec466-fe14-4460-826a-e3e00fa7b7c7 req-8771b8f9-1584-48f9-bf7b-af0edf9cbac3 service nova] Creating event network-vif-deleted:c7b02435-39c6-46a8-a356-81bef309201a for instance 8de4c382-e12d-4068-96c2-58d44e5265db on hv-cinder-86249 Oct 24 13:34:24.993519 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-8f1ec466-fe14-4460-826a-e3e00fa7b7c7 req-8771b8f9-1584-48f9-bf7b-af0edf9cbac3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069314 Oct 24 13:34:24.995261 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 472/949] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:34:25.995955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-780f007c-d0f1-402f-b82f-ee3d66165751 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:25.996578 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-780f007c-d0f1-402f-b82f-ee3d66165751 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:26.006816 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-780f007c-d0f1-402f-b82f-ee3d66165751 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:26.007834 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-780f007c-d0f1-402f-b82f-ee3d66165751 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:26.008307 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-780f007c-d0f1-402f-b82f-ee3d66165751 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:26.009233 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-780f007c-d0f1-402f-b82f-ee3d66165751 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:26.009696 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-780f007c-d0f1-402f-b82f-ee3d66165751 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:26.010115 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-780f007c-d0f1-402f-b82f-ee3d66165751 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:26.052981 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-780f007c-d0f1-402f-b82f-ee3d66165751 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:26.053609 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-780f007c-d0f1-402f-b82f-ee3d66165751 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:26.054044 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-780f007c-d0f1-402f-b82f-ee3d66165751 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:26.054512 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.objects.instance [None req-780f007c-d0f1-402f-b82f-ee3d66165751 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lazy-loading 'fault' on Instance uuid 8de4c382-e12d-4068-96c2-58d44e5265db {{(pid=119145) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:34:26.106066 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-780f007c-d0f1-402f-b82f-ee3d66165751 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:26.115087 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-780f007c-d0f1-402f-b82f-ee3d66165751 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 200 len: 1312 microversion: 2.1 time: 0.122805 Oct 24 13:34:26.116089 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 478/950] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:25 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 1312 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:26.228293 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-09f76651-4e2c-4af0-bf83-c8b4d15f5080 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Action: 'create', calling method: .version_select at 0x7f17a83e6b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-827635155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa/KQB3k6poq3dmnnCCQwIxhlenInqldzJl2vYLS/bAu1tc1CV4yGm25ludrUFS5lO2/+k5wqlr8mAuTJQtgELYDYnuvoPViRHMhwiPWa7+NdIlrHu5KA182aUQXcIogg=="}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:34:26.244946 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-09f76651-4e2c-4af0-bf83-c8b4d15f5080 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Getting quotas for project 46d41e46b7e3415684c32b22f31eefb5. Resources: {'key_pairs'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:34:26.249568 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-09f76651-4e2c-4af0-bf83-c8b4d15f5080 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Getting quotas for user cbdf62fbe49d44a58c294ac2c8b22ef5 and project 46d41e46b7e3415684c32b22f31eefb5. Resources: {'key_pairs'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:34:26.355664 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-09f76651-4e2c-4af0-bf83-c8b4d15f5080 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.329493 Oct 24 13:34:26.356301 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 473/951] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 24 13:34:26 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:34:27.138563 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-2677a571-2227-49d8-9d04-88c0295f8218 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:27.139165 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-2677a571-2227-49d8-9d04-88c0295f8218 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 8de4c382-e12d-4068-96c2-58d44e5265db] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:27.145972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2677a571-2227-49d8-9d04-88c0295f8218 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:27.146452 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2677a571-2227-49d8-9d04-88c0295f8218 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:27.147286 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2677a571-2227-49d8-9d04-88c0295f8218 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:27.147992 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2677a571-2227-49d8-9d04-88c0295f8218 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:27.148518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2677a571-2227-49d8-9d04-88c0295f8218 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:27.149116 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2677a571-2227-49d8-9d04-88c0295f8218 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:27.163795 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-2677a571-2227-49d8-9d04-88c0295f8218 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] HTTP exception thrown: Instance 8de4c382-e12d-4068-96c2-58d44e5265db could not be found. Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-2677a571-2227-49d8-9d04-88c0295f8218 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Request method failure captured: Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db HTTP/1.1 Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpJKIq5Rg50YSGQIjea3FRN8mTaXpsN5dA41WiaGbVh9lcQUtvdp2bBedjxQrf6lA7EHcL6QKUXInDPdjkl_Ihu9evaGWoTz8qUtj4HiB1zTeWk0JDMERKf8vFbcZFV6NCEsUhI2fpefVy7T0gdhukP3dZAyqmypjxu54EdjX60vHfw Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: 986792b802264c748e4614c4d2a17680 Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-440406220 Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:34:27.165717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:34:27.167471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_986792b802264c748e4614c4d2a17680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/986792b802264c748e4614c4d2a17680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/986792b802264c748e4614c4d2a17680"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/986792b802264c748e4614c4d2a17680"}]}] Oct 24 13:34:27.167471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-ServerRescueNegativeTestJSON-440406220 Oct 24 13:34:27.167471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: 986792b802264c748e4614c4d2a17680 Oct 24 13:34:27.167471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-440406220 Oct 24 13:34:27.167471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-ServerRescueNegativeTestJSON-440406220-project Oct 24 13:34:27.167471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:34:27.167471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:34:27.167471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 633c6c68e15f4be9a7289d15cac9de43 Oct 24 13:34:27.167471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-ServerRescueNegativeTestJSON-440406220-project Oct 24 13:34:27.167471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:34:27.167471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance 8de4c382-e12d-4068-96c2-58d44e5265db could not be found. Oct 24 13:34:27.167471 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': '8de4c382-e12d-4068-96c2-58d44e5265db'} Oct 24 13:34:27.168382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:34:27.168382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:34:27.168382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:34:27.168382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:34:27.168382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:34:27.168382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:34:27.168382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:34:27.168382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:34:27.168382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:34:27.168382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:34:27.168382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8de4c382-e12d-4068-96c2-58d44e5265db could not be found. Oct 24 13:34:27.168382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:34:27.168382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:34:27.168382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:34:27.168382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:34:27.168382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:34:27.168382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:34:27.168382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:34:27.168382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:34:27.168382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:34:27.169929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:34:27.169929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:34:27.169929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:34:27.169929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:34:27.169929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:34:27.169929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:34:27.169929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:34:27.169929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8de4c382-e12d-4068-96c2-58d44e5265db could not be found. Oct 24 13:34:27.169929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:34:27.169929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:34:27.169929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:34:27.169929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:34:27.169929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:34:27.169929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:34:27.169929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:34:27.169929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:34:27.169929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8de4c382-e12d-4068-96c2-58d44e5265db could not be found. Oct 24 13:34:27.169929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:34:27.171309 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-2677a571-2227-49d8-9d04-88c0295f8218 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Returning 404 to user: Instance 8de4c382-e12d-4068-96c2-58d44e5265db could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:34:27.171309 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-2677a571-2227-49d8-9d04-88c0295f8218 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db" status: 404 len: 111 microversion: 2.1 time: 0.032479 Oct 24 13:34:27.171309 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 479/952] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:27 2022] GET /compute/v2.1/servers/8de4c382-e12d-4068-96c2-58d44e5265db => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:34:27.176293 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-94b99222-4d1c-4ba9-a1ea-6820bc36a320 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:27.178882 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-94b99222-4d1c-4ba9-a1ea-6820bc36a320 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:27.184299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-94b99222-4d1c-4ba9-a1ea-6820bc36a320 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:27.184792 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-94b99222-4d1c-4ba9-a1ea-6820bc36a320 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:27.185223 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-94b99222-4d1c-4ba9-a1ea-6820bc36a320 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:27.185910 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-94b99222-4d1c-4ba9-a1ea-6820bc36a320 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:27.186353 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-94b99222-4d1c-4ba9-a1ea-6820bc36a320 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:27.186795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-94b99222-4d1c-4ba9-a1ea-6820bc36a320 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:27.211317 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-94b99222-4d1c-4ba9-a1ea-6820bc36a320 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Going to try to terminate instance {{(pid=119146) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:34:27.491536 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-94b99222-4d1c-4ba9-a1ea-6820bc36a320 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "DELETE /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 204 len: 0 microversion: 2.1 time: 0.319267 Oct 24 13:34:27.493025 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 474/953] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:34:27 2022] DELETE /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:34:27.501869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-39856476-8104-4772-83ba-d9dd8dff2007 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:27.502473 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-39856476-8104-4772-83ba-d9dd8dff2007 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:27.508561 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-39856476-8104-4772-83ba-d9dd8dff2007 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:27.509054 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-39856476-8104-4772-83ba-d9dd8dff2007 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:27.509462 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-39856476-8104-4772-83ba-d9dd8dff2007 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:27.510334 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-39856476-8104-4772-83ba-d9dd8dff2007 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:27.510778 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-39856476-8104-4772-83ba-d9dd8dff2007 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:27.511185 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-39856476-8104-4772-83ba-d9dd8dff2007 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:27.648472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-39856476-8104-4772-83ba-d9dd8dff2007 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:27.656858 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-39856476-8104-4772-83ba-d9dd8dff2007 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1520 microversion: 2.1 time: 0.159352 Oct 24 13:34:27.657429 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 480/954] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:27 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:34:28.685553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-80545285-c99e-4837-9512-42600082d248 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:28.685553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-80545285-c99e-4837-9512-42600082d248 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:28.693310 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-80545285-c99e-4837-9512-42600082d248 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:28.694036 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-80545285-c99e-4837-9512-42600082d248 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:28.694683 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-80545285-c99e-4837-9512-42600082d248 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:28.695557 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-80545285-c99e-4837-9512-42600082d248 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:28.696159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-80545285-c99e-4837-9512-42600082d248 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:28.696749 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-80545285-c99e-4837-9512-42600082d248 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:28.905004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-80545285-c99e-4837-9512-42600082d248 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:28.928884 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-80545285-c99e-4837-9512-42600082d248 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1520 microversion: 2.1 time: 0.239202 Oct 24 13:34:28.928884 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 475/955] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:28 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:29.309581 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-986a56bc-72bc-4e28-a147-b0b9941086f5 req-8de15b15-914f-4f49-9e8b-84efa60c7642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b2c12f-1e60-4000-ac5c-d7a5864939a1", "name": "network-vif-deleted", "tag": "cf65c088-1188-479e-a207-5b5919c77b82"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:34:29.324648 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-986a56bc-72bc-4e28-a147-b0b9941086f5 req-8de15b15-914f-4f49-9e8b-84efa60c7642 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:29.325635 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-986a56bc-72bc-4e28-a147-b0b9941086f5 req-8de15b15-914f-4f49-9e8b-84efa60c7642 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:29.326299 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-986a56bc-72bc-4e28-a147-b0b9941086f5 req-8de15b15-914f-4f49-9e8b-84efa60c7642 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:29.343872 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-986a56bc-72bc-4e28-a147-b0b9941086f5 req-8de15b15-914f-4f49-9e8b-84efa60c7642 service nova] Creating event network-vif-deleted:cf65c088-1188-479e-a207-5b5919c77b82 for instance 48b2c12f-1e60-4000-ac5c-d7a5864939a1 on hv-cinder-86249 Oct 24 13:34:29.350149 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-986a56bc-72bc-4e28-a147-b0b9941086f5 req-8de15b15-914f-4f49-9e8b-84efa60c7642 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044291 Oct 24 13:34:29.350895 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 481/956] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:34:29.944587 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-eba95c2b-feef-4c8b-8523-70dd886c370f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:29.945174 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-eba95c2b-feef-4c8b-8523-70dd886c370f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:29.950918 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:29.952872 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eba95c2b-feef-4c8b-8523-70dd886c370f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:29.953350 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eba95c2b-feef-4c8b-8523-70dd886c370f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:29.953775 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eba95c2b-feef-4c8b-8523-70dd886c370f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:29.954459 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eba95c2b-feef-4c8b-8523-70dd886c370f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:29.954907 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eba95c2b-feef-4c8b-8523-70dd886c370f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:29.955322 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eba95c2b-feef-4c8b-8523-70dd886c370f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:29.987850 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eba95c2b-feef-4c8b-8523-70dd886c370f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:29.988412 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eba95c2b-feef-4c8b-8523-70dd886c370f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:29.988840 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eba95c2b-feef-4c8b-8523-70dd886c370f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:29.989302 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.objects.instance [None req-eba95c2b-feef-4c8b-8523-70dd886c370f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lazy-loading 'fault' on Instance uuid 48b2c12f-1e60-4000-ac5c-d7a5864939a1 {{(pid=119146) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:34:30.034963 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-eba95c2b-feef-4c8b-8523-70dd886c370f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '633c6c68e15f4be9a7289d15cac9de43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '986792b802264c748e4614c4d2a17680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:30.040262 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-eba95c2b-feef-4c8b-8523-70dd886c370f tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 200 len: 1312 microversion: 2.1 time: 0.100897 Oct 24 13:34:30.040878 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 476/957] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:29 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:31.064110 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-bf5de72c-d1b5-40bf-9615-417aba629566 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:31.064833 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-bf5de72c-d1b5-40bf-9615-417aba629566 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] [instance: 48b2c12f-1e60-4000-ac5c-d7a5864939a1] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:31.071601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bf5de72c-d1b5-40bf-9615-417aba629566 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:31.072088 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bf5de72c-d1b5-40bf-9615-417aba629566 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:31.072544 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bf5de72c-d1b5-40bf-9615-417aba629566 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:31.073238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bf5de72c-d1b5-40bf-9615-417aba629566 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:31.073689 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bf5de72c-d1b5-40bf-9615-417aba629566 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:31.074109 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bf5de72c-d1b5-40bf-9615-417aba629566 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:31.091675 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-bf5de72c-d1b5-40bf-9615-417aba629566 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] HTTP exception thrown: Instance 48b2c12f-1e60-4000-ac5c-d7a5864939a1 could not be found. Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-bf5de72c-d1b5-40bf-9615-417aba629566 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Request method failure captured: Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 HTTP/1.1 Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpJKIq5Rg50YSGQIjea3FRN8mTaXpsN5dA41WiaGbVh9lcQUtvdp2bBedjxQrf6lA7EHcL6QKUXInDPdjkl_Ihu9evaGWoTz8qUtj4HiB1zTeWk0JDMERKf8vFbcZFV6NCEsUhI2fpefVy7T0gdhukP3dZAyqmypjxu54EdjX60vHfw Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: 986792b802264c748e4614c4d2a17680 Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-440406220 Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:34:31.099345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:34:31.101412 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_986792b802264c748e4614c4d2a17680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/986792b802264c748e4614c4d2a17680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/986792b802264c748e4614c4d2a17680"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/986792b802264c748e4614c4d2a17680"}]}] Oct 24 13:34:31.101412 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-ServerRescueNegativeTestJSON-440406220 Oct 24 13:34:31.101412 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: 986792b802264c748e4614c4d2a17680 Oct 24 13:34:31.101412 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-440406220 Oct 24 13:34:31.101412 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-ServerRescueNegativeTestJSON-440406220-project Oct 24 13:34:31.101412 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:34:31.101412 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:34:31.101412 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 633c6c68e15f4be9a7289d15cac9de43 Oct 24 13:34:31.101412 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-ServerRescueNegativeTestJSON-440406220-project Oct 24 13:34:31.101412 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:34:31.101412 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance 48b2c12f-1e60-4000-ac5c-d7a5864939a1 could not be found. Oct 24 13:34:31.101412 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': '48b2c12f-1e60-4000-ac5c-d7a5864939a1'} Oct 24 13:34:31.103265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:34:31.103265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:34:31.103265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:34:31.103265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:34:31.103265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:34:31.103265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:34:31.103265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:34:31.103265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:34:31.103265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:34:31.103265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:34:31.103265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48b2c12f-1e60-4000-ac5c-d7a5864939a1 could not be found. Oct 24 13:34:31.103265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:34:31.103265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:34:31.103265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:34:31.103265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:34:31.103265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:34:31.103265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:34:31.103265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:34:31.103265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:34:31.103265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:34:31.104972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:34:31.104972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:34:31.104972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:34:31.104972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:34:31.104972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:34:31.104972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:34:31.104972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:34:31.104972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48b2c12f-1e60-4000-ac5c-d7a5864939a1 could not be found. Oct 24 13:34:31.104972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:34:31.104972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:34:31.104972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:34:31.104972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:34:31.104972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:34:31.104972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:34:31.104972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:34:31.104972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:34:31.104972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48b2c12f-1e60-4000-ac5c-d7a5864939a1 could not be found. Oct 24 13:34:31.104972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:34:31.106413 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-bf5de72c-d1b5-40bf-9615-417aba629566 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] Returning 404 to user: Instance 48b2c12f-1e60-4000-ac5c-d7a5864939a1 could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:34:31.106413 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-bf5de72c-d1b5-40bf-9615-417aba629566 tempest-ServerRescueNegativeTestJSON-440406220 tempest-ServerRescueNegativeTestJSON-440406220-project] 10.222.0.48 "GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1" status: 404 len: 111 microversion: 2.1 time: 0.035827 Oct 24 13:34:31.106413 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 482/958] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:31 2022] GET /compute/v2.1/servers/48b2c12f-1e60-4000-ac5c-d7a5864939a1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:34:38.404443 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-6e518297-5cac-4ea7-a68c-dd7855482231 tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] Calling method '.version_select at 0x7f17a3ffc1f0>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:38.412173 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=4 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:38.453028 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-6e518297-5cac-4ea7-a68c-dd7855482231 tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/c9471afc-fd55-4b73-bbad-9fa0782908d9" status: 200 len: 351 microversion: 2.1 time: 0.052377 Oct 24 13:34:38.453595 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 477/959] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 24 13:34:38 2022] GET /compute/v2.1/os-volumes/c9471afc-fd55-4b73-bbad-9fa0782908d9 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:34:39.987949 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-22a96f03-3460-40e7-b7af-5585f41d605c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:39.988472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-22a96f03-3460-40e7-b7af-5585f41d605c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:39.992823 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:39.996171 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-22a96f03-3460-40e7-b7af-5585f41d605c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:39.996670 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-22a96f03-3460-40e7-b7af-5585f41d605c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:39.997104 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-22a96f03-3460-40e7-b7af-5585f41d605c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:39.997791 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-22a96f03-3460-40e7-b7af-5585f41d605c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:39.998241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-22a96f03-3460-40e7-b7af-5585f41d605c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:39.998660 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-22a96f03-3460-40e7-b7af-5585f41d605c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:40.002322 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:40.022183 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-22a96f03-3460-40e7-b7af-5585f41d605c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69/ips" status: 200 len: 152 microversion: 2.20 time: 0.037940 Oct 24 13:34:40.022744 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 483/960] 10.222.0.48 () {60 vars in 1289 bytes} [Mon Oct 24 13:34:39 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:34:41.088756 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:41.093429 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8d04071a-6ea5-4ad1-a63a-006a82e10c39 tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] Calling method '.version_select at 0x7f17a82e8550>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:41.141952 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8d04071a-6ea5-4ad1-a63a-006a82e10c39 tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/90fb2f76-cfad-4827-83d1-5bdec50a14c3" status: 200 len: 351 microversion: 2.1 time: 0.054326 Oct 24 13:34:41.142601 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 478/961] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 24 13:34:41 2022] GET /compute/v2.1/os-volumes/90fb2f76-cfad-4827-83d1-5bdec50a14c3 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:34:43.208995 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-365e3304-5dbd-4fb4-8ca2-c4ea95a015ae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:34:43.209606 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-365e3304-5dbd-4fb4-8ca2-c4ea95a015ae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:43.217313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-365e3304-5dbd-4fb4-8ca2-c4ea95a015ae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:43.217785 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-365e3304-5dbd-4fb4-8ca2-c4ea95a015ae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:43.218207 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-365e3304-5dbd-4fb4-8ca2-c4ea95a015ae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:43.218877 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-365e3304-5dbd-4fb4-8ca2-c4ea95a015ae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:43.219317 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-365e3304-5dbd-4fb4-8ca2-c4ea95a015ae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:43.219766 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-365e3304-5dbd-4fb4-8ca2-c4ea95a015ae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:43.244181 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.objects.instance [None req-365e3304-5dbd-4fb4-8ca2-c4ea95a015ae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lazy-loading 'flavor' on Instance uuid 6e111014-8ecb-4f6c-865f-a85b64d7cc69 {{(pid=119145) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:34:43.727137 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5304f52f-099e-4eca-b80e-977d5be8fa5e tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] Calling method '.version_select at 0x7f17a3f4fb80>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:43.733173 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-365e3304-5dbd-4fb4-8ca2-c4ea95a015ae tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "POST /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69/action" status: 202 len: 0 microversion: 2.20 time: 0.527925 Oct 24 13:34:43.733997 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 484/962] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 24 13:34:43 2022] POST /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:34:43.752459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e3142798-73e6-4ded-8af2-e55c02005a28 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:43.754181 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e3142798-73e6-4ded-8af2-e55c02005a28 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:43.759954 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e3142798-73e6-4ded-8af2-e55c02005a28 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:43.760500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e3142798-73e6-4ded-8af2-e55c02005a28 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:43.760925 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e3142798-73e6-4ded-8af2-e55c02005a28 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:43.761604 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e3142798-73e6-4ded-8af2-e55c02005a28 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:43.762074 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e3142798-73e6-4ded-8af2-e55c02005a28 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:43.762488 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e3142798-73e6-4ded-8af2-e55c02005a28 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:43.780671 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5304f52f-099e-4eca-b80e-977d5be8fa5e tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/00289864-06a5-4070-ad35-c6329b86de06" status: 200 len: 351 microversion: 2.1 time: 0.058001 Oct 24 13:34:43.781231 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 479/963] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 24 13:34:43 2022] GET /compute/v2.1/os-volumes/00289864-06a5-4070-ad35-c6329b86de06 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:34:43.795278 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1ba622a1-8307-41fc-93a1-0a19ca917151 tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] Calling method '.version_select at 0x7f17a3ffc310>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:43.879819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1ba622a1-8307-41fc-93a1-0a19ca917151 tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.088183 Oct 24 13:34:43.880446 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 480/964] 10.222.0.48 () {58 vars in 1134 bytes} [Mon Oct 24 13:34:43 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:43.894793 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b7f8dce4-2a1a-45d2-bf68-93a12bf2d6e1 tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] Calling method '.version_select at 0x7f17a82fa8b0>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:43.901553 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e3142798-73e6-4ded-8af2-e55c02005a28 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:43.910101 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e3142798-73e6-4ded-8af2-e55c02005a28 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:43.911606 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e3142798-73e6-4ded-8af2-e55c02005a28 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:43.912815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e3142798-73e6-4ded-8af2-e55c02005a28 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1723 microversion: 2.20 time: 0.164959 Oct 24 13:34:43.913350 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 485/965] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:34:43 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:34:43.979806 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b7f8dce4-2a1a-45d2-bf68-93a12bf2d6e1 tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.088604 Oct 24 13:34:43.980435 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 481/966] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Oct 24 13:34:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:34:43.995014 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-15c5da0d-04db-4de0-8d23-60f6b99eff1b tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] Calling method '.version_select at 0x7f17a8055ee0>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:44.076546 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-15c5da0d-04db-4de0-8d23-60f6b99eff1b tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.085838 Oct 24 13:34:44.077110 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 486/967] 10.222.0.48 () {58 vars in 1134 bytes} [Mon Oct 24 13:34:43 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:44.090333 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-875e5fe4-bcb5-450b-9627-580973fd68dc tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] Calling method '.version_select at 0x7f17a8d65940>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:44.171981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-875e5fe4-bcb5-450b-9627-580973fd68dc tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085394 Oct 24 13:34:44.172607 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 482/968] 10.222.0.48 () {58 vars in 1167 bytes} [Mon Oct 24 13:34:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:34:44.186681 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7edae18d-099c-4500-b242-3355ca1ed485 tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] Calling method '.version_select at 0x7f17ab940820>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:44.267627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-7edae18d-099c-4500-b242-3355ca1ed485 tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.084608 Oct 24 13:34:44.268368 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 487/969] 10.222.0.48 () {58 vars in 1170 bytes} [Mon Oct 24 13:34:44 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:34:44.281716 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e44a8416-102f-443a-8577-6828847bf08c tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] Calling method '.version_select at 0x7f17a3f4f3a0>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:44.362548 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e44a8416-102f-443a-8577-6828847bf08c tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.084509 Oct 24 13:34:44.363116 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 483/970] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Oct 24 13:34:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:44.376953 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e9e70b6a-a0ee-4975-9bf0-8bfe40521375 tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] Calling method '.version_select at 0x7f17ab966d30>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:44.459979 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e9e70b6a-a0ee-4975-9bf0-8bfe40521375 tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086764 Oct 24 13:34:44.460585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 488/971] 10.222.0.48 () {58 vars in 1188 bytes} [Mon Oct 24 13:34:44 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:34:44.473627 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7bceb010-af60-4695-a14a-2af0529723c0 tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] Calling method '.version_select at 0x7f17a821c040>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:44.554128 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7bceb010-af60-4695-a14a-2af0529723c0 tempest-VolumesTestJSON-1670220606 tempest-VolumesTestJSON-1670220606-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.084144 Oct 24 13:34:44.554696 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 484/972] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Oct 24 13:34:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:44.938490 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-37ab3a37-b41c-4366-88cc-a2e1e4bb74b3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:44.939132 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-37ab3a37-b41c-4366-88cc-a2e1e4bb74b3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:44.945156 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37ab3a37-b41c-4366-88cc-a2e1e4bb74b3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:44.945634 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37ab3a37-b41c-4366-88cc-a2e1e4bb74b3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:44.946113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37ab3a37-b41c-4366-88cc-a2e1e4bb74b3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:44.947317 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37ab3a37-b41c-4366-88cc-a2e1e4bb74b3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:44.947772 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37ab3a37-b41c-4366-88cc-a2e1e4bb74b3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:44.948190 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37ab3a37-b41c-4366-88cc-a2e1e4bb74b3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:45.075848 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-37ab3a37-b41c-4366-88cc-a2e1e4bb74b3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:45.084102 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-37ab3a37-b41c-4366-88cc-a2e1e4bb74b3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:45.085567 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-37ab3a37-b41c-4366-88cc-a2e1e4bb74b3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:45.086738 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-37ab3a37-b41c-4366-88cc-a2e1e4bb74b3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1723 microversion: 2.20 time: 0.152220 Oct 24 13:34:45.087934 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 489/973] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:34:44 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:34:46.113919 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7bb87690-d93e-4e13-bdde-00c3c8839524 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:46.114603 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7bb87690-d93e-4e13-bdde-00c3c8839524 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:46.121455 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7bb87690-d93e-4e13-bdde-00c3c8839524 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:46.121938 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7bb87690-d93e-4e13-bdde-00c3c8839524 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:46.122379 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7bb87690-d93e-4e13-bdde-00c3c8839524 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:46.123068 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7bb87690-d93e-4e13-bdde-00c3c8839524 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:46.123519 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7bb87690-d93e-4e13-bdde-00c3c8839524 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:46.123941 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7bb87690-d93e-4e13-bdde-00c3c8839524 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:46.251124 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7bb87690-d93e-4e13-bdde-00c3c8839524 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:46.259089 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7bb87690-d93e-4e13-bdde-00c3c8839524 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:46.261153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7bb87690-d93e-4e13-bdde-00c3c8839524 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:46.262352 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7bb87690-d93e-4e13-bdde-00c3c8839524 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1723 microversion: 2.20 time: 0.152896 Oct 24 13:34:46.262939 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 485/974] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:34:46 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:34:47.288045 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b9be528a-3455-4fc6-a668-a34d95305085 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:47.288676 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b9be528a-3455-4fc6-a668-a34d95305085 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:47.295355 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b9be528a-3455-4fc6-a668-a34d95305085 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:47.295821 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b9be528a-3455-4fc6-a668-a34d95305085 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:47.296244 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b9be528a-3455-4fc6-a668-a34d95305085 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:47.297100 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b9be528a-3455-4fc6-a668-a34d95305085 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:47.297546 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b9be528a-3455-4fc6-a668-a34d95305085 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:47.297958 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b9be528a-3455-4fc6-a668-a34d95305085 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:47.426550 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b9be528a-3455-4fc6-a668-a34d95305085 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:47.434582 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b9be528a-3455-4fc6-a668-a34d95305085 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:47.436021 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b9be528a-3455-4fc6-a668-a34d95305085 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:47.437248 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b9be528a-3455-4fc6-a668-a34d95305085 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1723 microversion: 2.20 time: 0.153120 Oct 24 13:34:47.437788 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 490/975] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:34:47 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:34:48.462996 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f6c4df09-aec2-4608-976d-95518608d021 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:48.463699 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f6c4df09-aec2-4608-976d-95518608d021 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:48.470170 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f6c4df09-aec2-4608-976d-95518608d021 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:48.470650 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f6c4df09-aec2-4608-976d-95518608d021 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:48.471080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f6c4df09-aec2-4608-976d-95518608d021 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:48.471765 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f6c4df09-aec2-4608-976d-95518608d021 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:48.472214 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f6c4df09-aec2-4608-976d-95518608d021 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:48.472666 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f6c4df09-aec2-4608-976d-95518608d021 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:48.601068 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f6c4df09-aec2-4608-976d-95518608d021 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:48.609310 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f6c4df09-aec2-4608-976d-95518608d021 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:48.610763 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f6c4df09-aec2-4608-976d-95518608d021 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:48.611914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f6c4df09-aec2-4608-976d-95518608d021 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1723 microversion: 2.20 time: 0.152900 Oct 24 13:34:48.612492 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 486/976] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:34:48 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:34:49.637868 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-5aae9978-3ffe-447d-abf6-42c87f449d17 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:49.638549 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-5aae9978-3ffe-447d-abf6-42c87f449d17 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:49.644938 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5aae9978-3ffe-447d-abf6-42c87f449d17 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:49.645414 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5aae9978-3ffe-447d-abf6-42c87f449d17 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:49.645842 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5aae9978-3ffe-447d-abf6-42c87f449d17 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:49.646518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5aae9978-3ffe-447d-abf6-42c87f449d17 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:49.646967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5aae9978-3ffe-447d-abf6-42c87f449d17 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:49.647385 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5aae9978-3ffe-447d-abf6-42c87f449d17 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:49.780818 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-5aae9978-3ffe-447d-abf6-42c87f449d17 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:49.788833 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-5aae9978-3ffe-447d-abf6-42c87f449d17 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:49.790250 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-5aae9978-3ffe-447d-abf6-42c87f449d17 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:49.792029 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-5aae9978-3ffe-447d-abf6-42c87f449d17 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1723 microversion: 2.20 time: 0.157621 Oct 24 13:34:49.792607 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 491/977] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:34:49 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:34:50.817519 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-189a3500-bb3e-41db-bc5a-f97e62a8ed67 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:50.818123 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-189a3500-bb3e-41db-bc5a-f97e62a8ed67 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:50.825665 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-189a3500-bb3e-41db-bc5a-f97e62a8ed67 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:50.826143 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-189a3500-bb3e-41db-bc5a-f97e62a8ed67 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:50.826572 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-189a3500-bb3e-41db-bc5a-f97e62a8ed67 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:50.827254 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-189a3500-bb3e-41db-bc5a-f97e62a8ed67 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:50.827719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-189a3500-bb3e-41db-bc5a-f97e62a8ed67 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:50.828116 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-189a3500-bb3e-41db-bc5a-f97e62a8ed67 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:50.959291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-189a3500-bb3e-41db-bc5a-f97e62a8ed67 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:50.967546 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-189a3500-bb3e-41db-bc5a-f97e62a8ed67 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:50.969082 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-189a3500-bb3e-41db-bc5a-f97e62a8ed67 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:50.970184 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-189a3500-bb3e-41db-bc5a-f97e62a8ed67 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1723 microversion: 2.20 time: 0.156583 Oct 24 13:34:50.970746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 487/978] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:34:50 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:34:51.995860 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ffcb0638-db04-4463-9b22-1cec9c72197c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:51.996397 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ffcb0638-db04-4463-9b22-1cec9c72197c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:52.002506 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ffcb0638-db04-4463-9b22-1cec9c72197c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:52.002979 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ffcb0638-db04-4463-9b22-1cec9c72197c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:52.003418 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ffcb0638-db04-4463-9b22-1cec9c72197c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:52.004097 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ffcb0638-db04-4463-9b22-1cec9c72197c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:52.004573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ffcb0638-db04-4463-9b22-1cec9c72197c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:52.004994 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ffcb0638-db04-4463-9b22-1cec9c72197c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:52.141060 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ffcb0638-db04-4463-9b22-1cec9c72197c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:52.150056 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ffcb0638-db04-4463-9b22-1cec9c72197c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:52.151905 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ffcb0638-db04-4463-9b22-1cec9c72197c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:52.153125 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ffcb0638-db04-4463-9b22-1cec9c72197c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1723 microversion: 2.20 time: 0.161496 Oct 24 13:34:52.168565 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 492/979] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:34:51 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:34:53.179259 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7fc1a31c-5c4a-4a21-ac91-4de4c811b765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:53.179862 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7fc1a31c-5c4a-4a21-ac91-4de4c811b765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:53.186196 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7fc1a31c-5c4a-4a21-ac91-4de4c811b765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:53.186669 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7fc1a31c-5c4a-4a21-ac91-4de4c811b765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:53.187091 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7fc1a31c-5c4a-4a21-ac91-4de4c811b765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:53.187820 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7fc1a31c-5c4a-4a21-ac91-4de4c811b765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:53.188294 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7fc1a31c-5c4a-4a21-ac91-4de4c811b765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:53.188711 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7fc1a31c-5c4a-4a21-ac91-4de4c811b765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:53.328119 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7fc1a31c-5c4a-4a21-ac91-4de4c811b765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:53.336343 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7fc1a31c-5c4a-4a21-ac91-4de4c811b765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:53.337824 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7fc1a31c-5c4a-4a21-ac91-4de4c811b765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:53.339560 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7fc1a31c-5c4a-4a21-ac91-4de4c811b765 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1723 microversion: 2.20 time: 0.163741 Oct 24 13:34:53.340204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 488/980] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:34:53 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:34:54.365851 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ffe45f14-cd76-440c-86f3-0861469056f6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:54.366463 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ffe45f14-cd76-440c-86f3-0861469056f6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:54.373627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ffe45f14-cd76-440c-86f3-0861469056f6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:54.374287 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ffe45f14-cd76-440c-86f3-0861469056f6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:54.374657 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ffe45f14-cd76-440c-86f3-0861469056f6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:54.375512 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ffe45f14-cd76-440c-86f3-0861469056f6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:54.376838 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ffe45f14-cd76-440c-86f3-0861469056f6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:54.377289 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ffe45f14-cd76-440c-86f3-0861469056f6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:54.468625 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-91abbb4d-07bc-463f-ae3d-3621e888eac3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-119095810", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-827635155", "security_groups": [{"name": "tempest-secgroup-smoke-14826782"}], "block_device_mapping_v2": [{"uuid": "f117c692-17f1-4e58-90e4-cea390d389c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f594f9ca-1fdb-418d-87fd-7e11dd1c7532"}]}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:34:54.519315 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ffe45f14-cd76-440c-86f3-0861469056f6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:54.527989 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ffe45f14-cd76-440c-86f3-0861469056f6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:54.529502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ffe45f14-cd76-440c-86f3-0861469056f6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:54.530656 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ffe45f14-cd76-440c-86f3-0861469056f6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1723 microversion: 2.20 time: 0.168817 Oct 24 13:34:54.531202 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 493/981] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:34:54 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:34:54.587913 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.network.neutron [None req-91abbb4d-07bc-463f-ae3d-3621e888eac3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] validate_networks() for [('f594f9ca-1fdb-418d-87fd-7e11dd1c7532', None, None, None, None, None)] {{(pid=119146) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:34:54.969719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-91abbb4d-07bc-463f-ae3d-3621e888eac3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Flavor limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:34:54.970214 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-91abbb4d-07bc-463f-ae3d-3621e888eac3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Image limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:34:54.970759 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-91abbb4d-07bc-463f-ae3d-3621e888eac3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Flavor pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:34:54.971270 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-91abbb4d-07bc-463f-ae3d-3621e888eac3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Image pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:34:54.971858 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-91abbb4d-07bc-463f-ae3d-3621e888eac3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:34:54.981578 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-91abbb4d-07bc-463f-ae3d-3621e888eac3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:54.982063 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-91abbb4d-07bc-463f-ae3d-3621e888eac3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:54.982494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-91abbb4d-07bc-463f-ae3d-3621e888eac3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:54.983209 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-91abbb4d-07bc-463f-ae3d-3621e888eac3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:54.983660 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-91abbb4d-07bc-463f-ae3d-3621e888eac3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:54.984078 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-91abbb4d-07bc-463f-ae3d-3621e888eac3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:55.000958 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-91abbb4d-07bc-463f-ae3d-3621e888eac3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Getting quotas for project 46d41e46b7e3415684c32b22f31eefb5. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:34:55.004852 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-91abbb4d-07bc-463f-ae3d-3621e888eac3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Getting quotas for user cbdf62fbe49d44a58c294ac2c8b22ef5 and project 46d41e46b7e3415684c32b22f31eefb5. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:34:55.063250 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-91abbb4d-07bc-463f-ae3d-3621e888eac3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Going to run 1 instances... {{(pid=119146) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:34:55.065433 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-91abbb4d-07bc-463f-ae3d-3621e888eac3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f117c692-17f1-4e58-90e4-cea390d389c7',volume_size=None,volume_type=None)] {{(pid=119146) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:34:55.423961 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-91abbb4d-07bc-463f-ae3d-3621e888eac3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.959180 Oct 24 13:34:55.424645 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 489/982] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 24 13:34:54 2022] POST /compute/v2.1/servers => generated 404 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 13:34:55.435584 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-aef8801f-14df-4a2b-855b-7e89ef202fa2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:55.436199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-aef8801f-14df-4a2b-855b-7e89ef202fa2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:55.494787 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-aef8801f-14df-4a2b-855b-7e89ef202fa2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:55.502318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-aef8801f-14df-4a2b-855b-7e89ef202fa2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1093 microversion: 2.1 time: 0.070547 Oct 24 13:34:55.503058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 494/983] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:55 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:55.559905 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3de0ede4-599d-43ac-9885-aaa4b0369843 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:55.560560 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-3de0ede4-599d-43ac-9885-aaa4b0369843 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:55.566939 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3de0ede4-599d-43ac-9885-aaa4b0369843 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:55.567425 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3de0ede4-599d-43ac-9885-aaa4b0369843 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:55.567859 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3de0ede4-599d-43ac-9885-aaa4b0369843 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:55.568750 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3de0ede4-599d-43ac-9885-aaa4b0369843 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:55.569206 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3de0ede4-599d-43ac-9885-aaa4b0369843 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:55.569631 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3de0ede4-599d-43ac-9885-aaa4b0369843 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:55.716178 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3de0ede4-599d-43ac-9885-aaa4b0369843 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:55.724882 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3de0ede4-599d-43ac-9885-aaa4b0369843 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:55.726422 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3de0ede4-599d-43ac-9885-aaa4b0369843 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:55.727683 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3de0ede4-599d-43ac-9885-aaa4b0369843 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1723 microversion: 2.20 time: 0.173123 Oct 24 13:34:55.728344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 490/984] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:34:55 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:34:56.528988 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-d8ca4a47-4f13-480a-a7b4-4c654f1a5e94 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:56.529654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-d8ca4a47-4f13-480a-a7b4-4c654f1a5e94 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:56.539247 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d8ca4a47-4f13-480a-a7b4-4c654f1a5e94 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:56.539247 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d8ca4a47-4f13-480a-a7b4-4c654f1a5e94 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:56.539247 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d8ca4a47-4f13-480a-a7b4-4c654f1a5e94 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:56.539247 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d8ca4a47-4f13-480a-a7b4-4c654f1a5e94 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:56.539664 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d8ca4a47-4f13-480a-a7b4-4c654f1a5e94 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:56.539841 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d8ca4a47-4f13-480a-a7b4-4c654f1a5e94 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:56.600261 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-d8ca4a47-4f13-480a-a7b4-4c654f1a5e94 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:56.608630 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-d8ca4a47-4f13-480a-a7b4-4c654f1a5e94 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1143 microversion: 2.1 time: 0.086105 Oct 24 13:34:56.609203 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 495/985] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:56 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:56.753228 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ee28a6fd-3cb3-4a2b-bcb9-e42fa280ef6f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:56.753842 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-ee28a6fd-3cb3-4a2b-bcb9-e42fa280ef6f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:56.760364 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee28a6fd-3cb3-4a2b-bcb9-e42fa280ef6f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:56.761425 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee28a6fd-3cb3-4a2b-bcb9-e42fa280ef6f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:56.761902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee28a6fd-3cb3-4a2b-bcb9-e42fa280ef6f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:56.762598 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee28a6fd-3cb3-4a2b-bcb9-e42fa280ef6f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:56.763049 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee28a6fd-3cb3-4a2b-bcb9-e42fa280ef6f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:56.763469 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ee28a6fd-3cb3-4a2b-bcb9-e42fa280ef6f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:56.933396 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ee28a6fd-3cb3-4a2b-bcb9-e42fa280ef6f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:56.942111 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ee28a6fd-3cb3-4a2b-bcb9-e42fa280ef6f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:56.943529 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ee28a6fd-3cb3-4a2b-bcb9-e42fa280ef6f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:56.944802 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-ee28a6fd-3cb3-4a2b-bcb9-e42fa280ef6f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1723 microversion: 2.20 time: 0.195486 Oct 24 13:34:56.945393 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 491/986] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:34:56 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:34:57.630921 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-1bdc1776-d540-4b67-a285-0e51532710e9 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:57.631540 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-1bdc1776-d540-4b67-a285-0e51532710e9 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:57.638632 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1bdc1776-d540-4b67-a285-0e51532710e9 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:57.639108 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1bdc1776-d540-4b67-a285-0e51532710e9 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:57.639531 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1bdc1776-d540-4b67-a285-0e51532710e9 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:57.640211 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1bdc1776-d540-4b67-a285-0e51532710e9 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:57.640822 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1bdc1776-d540-4b67-a285-0e51532710e9 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:57.641243 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1bdc1776-d540-4b67-a285-0e51532710e9 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:57.721869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1bdc1776-d540-4b67-a285-0e51532710e9 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:57.730453 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-1bdc1776-d540-4b67-a285-0e51532710e9 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1199 microversion: 2.1 time: 0.103221 Oct 24 13:34:57.744776 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 496/987] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:57 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1199 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:57.971797 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7ecba287-9d26-4520-a163-e570e894f337 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:57.972554 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7ecba287-9d26-4520-a163-e570e894f337 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:57.979040 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ecba287-9d26-4520-a163-e570e894f337 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:57.979526 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ecba287-9d26-4520-a163-e570e894f337 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:57.979952 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ecba287-9d26-4520-a163-e570e894f337 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:57.980670 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ecba287-9d26-4520-a163-e570e894f337 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:57.981144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ecba287-9d26-4520-a163-e570e894f337 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:57.981562 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ecba287-9d26-4520-a163-e570e894f337 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:58.126862 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7ecba287-9d26-4520-a163-e570e894f337 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:58.136665 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7ecba287-9d26-4520-a163-e570e894f337 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:58.138395 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7ecba287-9d26-4520-a163-e570e894f337 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:58.139581 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7ecba287-9d26-4520-a163-e570e894f337 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1723 microversion: 2.20 time: 0.172641 Oct 24 13:34:58.140164 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 492/988] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:34:57 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:34:58.752539 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-828bdf5f-f11b-428d-9de1-6c28a8128cf5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:58.753272 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-828bdf5f-f11b-428d-9de1-6c28a8128cf5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:58.760012 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-828bdf5f-f11b-428d-9de1-6c28a8128cf5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:58.760670 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-828bdf5f-f11b-428d-9de1-6c28a8128cf5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:58.761334 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-828bdf5f-f11b-428d-9de1-6c28a8128cf5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:58.762338 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-828bdf5f-f11b-428d-9de1-6c28a8128cf5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:58.762888 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-828bdf5f-f11b-428d-9de1-6c28a8128cf5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:58.763504 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-828bdf5f-f11b-428d-9de1-6c28a8128cf5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:58.975297 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-828bdf5f-f11b-428d-9de1-6c28a8128cf5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:58.985485 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-828bdf5f-f11b-428d-9de1-6c28a8128cf5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1275 microversion: 2.1 time: 0.236712 Oct 24 13:34:58.986329 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 497/989] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:34:58 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1275 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:59.165902 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ad25876b-84a2-4b93-9363-406e542a4895 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:59.167255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-ad25876b-84a2-4b93-9363-406e542a4895 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:34:59.175539 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ad25876b-84a2-4b93-9363-406e542a4895 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:59.176619 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ad25876b-84a2-4b93-9363-406e542a4895 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:59.181283 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ad25876b-84a2-4b93-9363-406e542a4895 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:59.181283 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ad25876b-84a2-4b93-9363-406e542a4895 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:59.181283 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ad25876b-84a2-4b93-9363-406e542a4895 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:59.181283 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ad25876b-84a2-4b93-9363-406e542a4895 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:59.327632 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ad25876b-84a2-4b93-9363-406e542a4895 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:59.336624 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ad25876b-84a2-4b93-9363-406e542a4895 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:59.338196 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ad25876b-84a2-4b93-9363-406e542a4895 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:34:59.340069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-ad25876b-84a2-4b93-9363-406e542a4895 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1723 microversion: 2.20 time: 0.178317 Oct 24 13:34:59.344347 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 493/990] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:34:59 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:34:59.491552 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-dd0ef137-8ff8-4372-a6b0-49baf6fd59d9 req-2ad8b5b7-6d37-4c67-9cb2-69e91afc0501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5762454b-33e1-445d-a5e5-be0b4ba78d7b", "tag": "d65e0e78-310d-4892-8600-9d032dcae474"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:34:59.501555 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-dd0ef137-8ff8-4372-a6b0-49baf6fd59d9 req-2ad8b5b7-6d37-4c67-9cb2-69e91afc0501 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:34:59.502026 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-dd0ef137-8ff8-4372-a6b0-49baf6fd59d9 req-2ad8b5b7-6d37-4c67-9cb2-69e91afc0501 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:34:59.502449 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-dd0ef137-8ff8-4372-a6b0-49baf6fd59d9 req-2ad8b5b7-6d37-4c67-9cb2-69e91afc0501 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:34:59.513620 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-dd0ef137-8ff8-4372-a6b0-49baf6fd59d9 req-2ad8b5b7-6d37-4c67-9cb2-69e91afc0501 service nova] Creating event network-changed:d65e0e78-310d-4892-8600-9d032dcae474 for instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b on hv-cinder-86249 Oct 24 13:34:59.518354 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-dd0ef137-8ff8-4372-a6b0-49baf6fd59d9 req-2ad8b5b7-6d37-4c67-9cb2-69e91afc0501 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030482 Oct 24 13:34:59.518943 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 498/991] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:35:00.009262 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5ed7695e-3412-4626-b86c-1446a4992a8f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:00.009874 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5ed7695e-3412-4626-b86c-1446a4992a8f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:00.015808 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5ed7695e-3412-4626-b86c-1446a4992a8f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:00.020439 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5ed7695e-3412-4626-b86c-1446a4992a8f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:00.020439 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5ed7695e-3412-4626-b86c-1446a4992a8f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:00.020439 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5ed7695e-3412-4626-b86c-1446a4992a8f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:00.020439 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5ed7695e-3412-4626-b86c-1446a4992a8f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:00.020842 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5ed7695e-3412-4626-b86c-1446a4992a8f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:00.157650 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5ed7695e-3412-4626-b86c-1446a4992a8f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:00.165725 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5ed7695e-3412-4626-b86c-1446a4992a8f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1263 microversion: 2.1 time: 0.160281 Oct 24 13:35:00.166301 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 494/992] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:35:00 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:35:00.367106 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a1f30a96-36a1-4d95-964c-f0ede91f7655 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:00.367729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a1f30a96-36a1-4d95-964c-f0ede91f7655 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:00.374007 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1f30a96-36a1-4d95-964c-f0ede91f7655 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:00.374483 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1f30a96-36a1-4d95-964c-f0ede91f7655 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:00.374910 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1f30a96-36a1-4d95-964c-f0ede91f7655 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:00.375624 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1f30a96-36a1-4d95-964c-f0ede91f7655 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:00.376087 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1f30a96-36a1-4d95-964c-f0ede91f7655 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:00.376520 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1f30a96-36a1-4d95-964c-f0ede91f7655 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:00.506661 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a1f30a96-36a1-4d95-964c-f0ede91f7655 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:00.515257 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a1f30a96-36a1-4d95-964c-f0ede91f7655 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:00.516723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a1f30a96-36a1-4d95-964c-f0ede91f7655 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:00.517878 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a1f30a96-36a1-4d95-964c-f0ede91f7655 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1723 microversion: 2.20 time: 0.155806 Oct 24 13:35:00.518455 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 499/993] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:00 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:01.189150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e6107d82-6689-4593-8594-8170c211400f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:01.189846 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e6107d82-6689-4593-8594-8170c211400f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:01.196145 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e6107d82-6689-4593-8594-8170c211400f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:01.196681 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e6107d82-6689-4593-8594-8170c211400f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:01.197149 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e6107d82-6689-4593-8594-8170c211400f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:01.197826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e6107d82-6689-4593-8594-8170c211400f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:01.198324 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e6107d82-6689-4593-8594-8170c211400f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:01.198742 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e6107d82-6689-4593-8594-8170c211400f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:01.328856 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e6107d82-6689-4593-8594-8170c211400f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:01.338210 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e6107d82-6689-4593-8594-8170c211400f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1263 microversion: 2.1 time: 0.152925 Oct 24 13:35:01.339830 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 495/994] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:35:01 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:35:01.543039 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-75c82c86-d876-4cc8-935a-4dd53827d12d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:01.543584 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-75c82c86-d876-4cc8-935a-4dd53827d12d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:01.549999 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-75c82c86-d876-4cc8-935a-4dd53827d12d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:01.550472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-75c82c86-d876-4cc8-935a-4dd53827d12d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:01.550900 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-75c82c86-d876-4cc8-935a-4dd53827d12d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:01.551578 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-75c82c86-d876-4cc8-935a-4dd53827d12d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:01.552024 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-75c82c86-d876-4cc8-935a-4dd53827d12d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:01.552482 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-75c82c86-d876-4cc8-935a-4dd53827d12d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:01.679052 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-75c82c86-d876-4cc8-935a-4dd53827d12d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:01.687065 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-75c82c86-d876-4cc8-935a-4dd53827d12d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:01.688533 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-75c82c86-d876-4cc8-935a-4dd53827d12d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:01.689678 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-75c82c86-d876-4cc8-935a-4dd53827d12d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1744 microversion: 2.20 time: 0.150704 Oct 24 13:35:01.690240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 500/995] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:01 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:02.361365 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1ac7421d-37a8-44d9-9d17-7dba7eb7105d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:02.362003 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-1ac7421d-37a8-44d9-9d17-7dba7eb7105d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:02.368293 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1ac7421d-37a8-44d9-9d17-7dba7eb7105d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:02.368791 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1ac7421d-37a8-44d9-9d17-7dba7eb7105d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:02.369207 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1ac7421d-37a8-44d9-9d17-7dba7eb7105d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:02.369896 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1ac7421d-37a8-44d9-9d17-7dba7eb7105d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:02.370340 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1ac7421d-37a8-44d9-9d17-7dba7eb7105d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:02.370762 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1ac7421d-37a8-44d9-9d17-7dba7eb7105d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:02.512747 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1ac7421d-37a8-44d9-9d17-7dba7eb7105d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:02.520604 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1ac7421d-37a8-44d9-9d17-7dba7eb7105d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1263 microversion: 2.1 time: 0.163078 Oct 24 13:35:02.526004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 496/996] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:35:02 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:35:02.715986 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ca673df3-27bd-4fd1-a16b-841148a69a1e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:02.716599 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ca673df3-27bd-4fd1-a16b-841148a69a1e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:02.722935 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ca673df3-27bd-4fd1-a16b-841148a69a1e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:02.723406 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ca673df3-27bd-4fd1-a16b-841148a69a1e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:02.723826 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ca673df3-27bd-4fd1-a16b-841148a69a1e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:02.724531 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ca673df3-27bd-4fd1-a16b-841148a69a1e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:02.724972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ca673df3-27bd-4fd1-a16b-841148a69a1e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:02.725382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ca673df3-27bd-4fd1-a16b-841148a69a1e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:02.857854 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ca673df3-27bd-4fd1-a16b-841148a69a1e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:02.866408 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ca673df3-27bd-4fd1-a16b-841148a69a1e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:02.867839 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ca673df3-27bd-4fd1-a16b-841148a69a1e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:02.869048 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ca673df3-27bd-4fd1-a16b-841148a69a1e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1744 microversion: 2.20 time: 0.156831 Oct 24 13:35:02.869611 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 501/997] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:02 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:03.546632 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f127a492-f845-4b3d-9032-697e6f66fab8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:03.547246 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f127a492-f845-4b3d-9032-697e6f66fab8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:03.553828 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f127a492-f845-4b3d-9032-697e6f66fab8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:03.554317 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f127a492-f845-4b3d-9032-697e6f66fab8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:03.554747 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f127a492-f845-4b3d-9032-697e6f66fab8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:03.555440 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f127a492-f845-4b3d-9032-697e6f66fab8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:03.555899 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f127a492-f845-4b3d-9032-697e6f66fab8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:03.556347 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f127a492-f845-4b3d-9032-697e6f66fab8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:03.689341 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f127a492-f845-4b3d-9032-697e6f66fab8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:03.697553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f127a492-f845-4b3d-9032-697e6f66fab8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1263 microversion: 2.1 time: 0.154810 Oct 24 13:35:03.698117 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 497/998] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:35:03 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:35:03.895000 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-bb71b8a2-b2d2-46bb-a336-1e24c1f353c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:03.895632 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-bb71b8a2-b2d2-46bb-a336-1e24c1f353c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:03.901986 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bb71b8a2-b2d2-46bb-a336-1e24c1f353c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:03.903068 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bb71b8a2-b2d2-46bb-a336-1e24c1f353c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:03.903495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bb71b8a2-b2d2-46bb-a336-1e24c1f353c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:03.904164 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bb71b8a2-b2d2-46bb-a336-1e24c1f353c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:03.904634 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bb71b8a2-b2d2-46bb-a336-1e24c1f353c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:03.905091 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bb71b8a2-b2d2-46bb-a336-1e24c1f353c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:04.033940 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-bb71b8a2-b2d2-46bb-a336-1e24c1f353c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:04.036219 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:04.042612 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-bb71b8a2-b2d2-46bb-a336-1e24c1f353c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:04.044029 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-bb71b8a2-b2d2-46bb-a336-1e24c1f353c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:04.046659 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-bb71b8a2-b2d2-46bb-a336-1e24c1f353c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1744 microversion: 2.20 time: 0.154236 Oct 24 13:35:04.046659 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 502/999] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:03 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:04.722038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-caa71722-6a25-4454-9d8b-d230cd10a8cb tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:04.722652 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-caa71722-6a25-4454-9d8b-d230cd10a8cb tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:04.729023 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-caa71722-6a25-4454-9d8b-d230cd10a8cb tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:04.729507 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-caa71722-6a25-4454-9d8b-d230cd10a8cb tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:04.729951 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-caa71722-6a25-4454-9d8b-d230cd10a8cb tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:04.731146 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-caa71722-6a25-4454-9d8b-d230cd10a8cb tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:04.731605 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-caa71722-6a25-4454-9d8b-d230cd10a8cb tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:04.732029 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-caa71722-6a25-4454-9d8b-d230cd10a8cb tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:04.863451 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-caa71722-6a25-4454-9d8b-d230cd10a8cb tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:04.871423 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-caa71722-6a25-4454-9d8b-d230cd10a8cb tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1263 microversion: 2.1 time: 0.153321 Oct 24 13:35:04.871998 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 498/1000] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:35:04 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:35:05.071276 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8a8a8a81-2fb4-43b0-a554-ced37fe84a5b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:05.071947 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-8a8a8a81-2fb4-43b0-a554-ced37fe84a5b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:05.079062 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8a8a8a81-2fb4-43b0-a554-ced37fe84a5b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:05.079502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8a8a8a81-2fb4-43b0-a554-ced37fe84a5b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:05.079935 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8a8a8a81-2fb4-43b0-a554-ced37fe84a5b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:05.080649 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8a8a8a81-2fb4-43b0-a554-ced37fe84a5b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:05.081097 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8a8a8a81-2fb4-43b0-a554-ced37fe84a5b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:05.081651 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8a8a8a81-2fb4-43b0-a554-ced37fe84a5b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:05.214382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-8a8a8a81-2fb4-43b0-a554-ced37fe84a5b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:05.222832 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-8a8a8a81-2fb4-43b0-a554-ced37fe84a5b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:05.224245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-8a8a8a81-2fb4-43b0-a554-ced37fe84a5b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:05.225412 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-8a8a8a81-2fb4-43b0-a554-ced37fe84a5b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1744 microversion: 2.20 time: 0.158514 Oct 24 13:35:05.225954 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 503/1001] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:05 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:05.894531 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-dd425c25-3335-4d14-8866-44c87fa58598 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:05.895119 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-dd425c25-3335-4d14-8866-44c87fa58598 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:05.896980 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=2 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:05.897648 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=6 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:05.902933 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dd425c25-3335-4d14-8866-44c87fa58598 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:05.903410 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dd425c25-3335-4d14-8866-44c87fa58598 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:05.903840 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dd425c25-3335-4d14-8866-44c87fa58598 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:05.904676 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dd425c25-3335-4d14-8866-44c87fa58598 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:05.905116 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dd425c25-3335-4d14-8866-44c87fa58598 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:05.905534 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dd425c25-3335-4d14-8866-44c87fa58598 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:06.042154 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-dd425c25-3335-4d14-8866-44c87fa58598 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:06.050042 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-dd425c25-3335-4d14-8866-44c87fa58598 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1263 microversion: 2.1 time: 0.159375 Oct 24 13:35:06.053865 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 499/1002] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:35:05 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:35:06.256468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-705480ea-cfb1-49aa-af04-2983b307c580 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:06.265889 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-705480ea-cfb1-49aa-af04-2983b307c580 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:06.266176 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-05b8af8c-6a40-4d3c-a24a-38e714b47c95 req-2c54b8fc-1827-480c-94a0-2869ef1d88b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e111014-8ecb-4f6c-865f-a85b64d7cc69", "name": "network-vif-plugged", "status": "completed", "tag": "13446e7b-9dfe-44f4-b0f9-5884ab770e75"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:06.268313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=2 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:06.271686 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-705480ea-cfb1-49aa-af04-2983b307c580 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:06.272166 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-705480ea-cfb1-49aa-af04-2983b307c580 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:06.272738 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-705480ea-cfb1-49aa-af04-2983b307c580 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:06.273308 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-705480ea-cfb1-49aa-af04-2983b307c580 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:06.273745 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-705480ea-cfb1-49aa-af04-2983b307c580 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:06.274162 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-705480ea-cfb1-49aa-af04-2983b307c580 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:06.275003 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-05b8af8c-6a40-4d3c-a24a-38e714b47c95 req-2c54b8fc-1827-480c-94a0-2869ef1d88b9 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:06.275539 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-05b8af8c-6a40-4d3c-a24a-38e714b47c95 req-2c54b8fc-1827-480c-94a0-2869ef1d88b9 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:06.276642 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-05b8af8c-6a40-4d3c-a24a-38e714b47c95 req-2c54b8fc-1827-480c-94a0-2869ef1d88b9 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:06.293043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-05b8af8c-6a40-4d3c-a24a-38e714b47c95 req-2c54b8fc-1827-480c-94a0-2869ef1d88b9 service nova] Creating event network-vif-plugged:13446e7b-9dfe-44f4-b0f9-5884ab770e75 for instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 on hv-cinder-86249 Oct 24 13:35:06.297352 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-05b8af8c-6a40-4d3c-a24a-38e714b47c95 req-2c54b8fc-1827-480c-94a0-2869ef1d88b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048376 Oct 24 13:35:06.298601 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 500/1003] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:06.409380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-705480ea-cfb1-49aa-af04-2983b307c580 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:06.417499 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-705480ea-cfb1-49aa-af04-2983b307c580 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:06.421069 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-705480ea-cfb1-49aa-af04-2983b307c580 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:06.422244 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-705480ea-cfb1-49aa-af04-2983b307c580 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1744 microversion: 2.20 time: 0.174910 Oct 24 13:35:06.422883 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 504/1004] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:06 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:07.072524 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-870bd7d1-5aef-4937-a891-9ca64f8943ea tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:07.073547 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-870bd7d1-5aef-4937-a891-9ca64f8943ea tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:07.085492 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-870bd7d1-5aef-4937-a891-9ca64f8943ea tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:07.085492 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-870bd7d1-5aef-4937-a891-9ca64f8943ea tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:07.085492 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-870bd7d1-5aef-4937-a891-9ca64f8943ea tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:07.085492 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-870bd7d1-5aef-4937-a891-9ca64f8943ea tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:07.085925 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-870bd7d1-5aef-4937-a891-9ca64f8943ea tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:07.085925 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-870bd7d1-5aef-4937-a891-9ca64f8943ea tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:07.217276 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-870bd7d1-5aef-4937-a891-9ca64f8943ea tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:07.225327 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-870bd7d1-5aef-4937-a891-9ca64f8943ea tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1263 microversion: 2.1 time: 0.157267 Oct 24 13:35:07.232529 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 501/1005] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:35:07 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:35:07.449187 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0ac6ffaf-975e-43e2-afe2-8a313ae7759e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:07.449751 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0ac6ffaf-975e-43e2-afe2-8a313ae7759e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:07.457128 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ac6ffaf-975e-43e2-afe2-8a313ae7759e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:07.457621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ac6ffaf-975e-43e2-afe2-8a313ae7759e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:07.458055 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ac6ffaf-975e-43e2-afe2-8a313ae7759e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:07.458756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ac6ffaf-975e-43e2-afe2-8a313ae7759e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:07.459206 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ac6ffaf-975e-43e2-afe2-8a313ae7759e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:07.459624 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0ac6ffaf-975e-43e2-afe2-8a313ae7759e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:07.606711 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0ac6ffaf-975e-43e2-afe2-8a313ae7759e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:07.614908 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0ac6ffaf-975e-43e2-afe2-8a313ae7759e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:07.616444 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0ac6ffaf-975e-43e2-afe2-8a313ae7759e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:07.617701 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0ac6ffaf-975e-43e2-afe2-8a313ae7759e tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1744 microversion: 2.20 time: 0.173014 Oct 24 13:35:07.618257 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 505/1006] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:07 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:08.254301 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-23a28167-4605-40da-bbc5-e6479851b8b1 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:08.254911 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-23a28167-4605-40da-bbc5-e6479851b8b1 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:08.263104 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-23a28167-4605-40da-bbc5-e6479851b8b1 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:08.264341 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-23a28167-4605-40da-bbc5-e6479851b8b1 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:08.264341 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-23a28167-4605-40da-bbc5-e6479851b8b1 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:08.264796 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-23a28167-4605-40da-bbc5-e6479851b8b1 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:08.265249 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-23a28167-4605-40da-bbc5-e6479851b8b1 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:08.265670 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-23a28167-4605-40da-bbc5-e6479851b8b1 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:08.398302 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-23a28167-4605-40da-bbc5-e6479851b8b1 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:08.404618 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=100 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:08.409335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-23a28167-4605-40da-bbc5-e6479851b8b1 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1263 microversion: 2.1 time: 0.159739 Oct 24 13:35:08.409938 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 502/1007] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:35:08 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:35:08.642881 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8ada3ecd-472d-449d-bca7-04e08a2c3b18 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:08.643488 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-8ada3ecd-472d-449d-bca7-04e08a2c3b18 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:08.649770 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8ada3ecd-472d-449d-bca7-04e08a2c3b18 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:08.650452 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8ada3ecd-472d-449d-bca7-04e08a2c3b18 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:08.651063 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8ada3ecd-472d-449d-bca7-04e08a2c3b18 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:08.651756 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8ada3ecd-472d-449d-bca7-04e08a2c3b18 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:08.652785 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8ada3ecd-472d-449d-bca7-04e08a2c3b18 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:08.653147 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8ada3ecd-472d-449d-bca7-04e08a2c3b18 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:08.790866 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-8ada3ecd-472d-449d-bca7-04e08a2c3b18 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:08.799742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-8ada3ecd-472d-449d-bca7-04e08a2c3b18 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:08.801208 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-8ada3ecd-472d-449d-bca7-04e08a2c3b18 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:08.802340 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-8ada3ecd-472d-449d-bca7-04e08a2c3b18 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1744 microversion: 2.20 time: 0.163247 Oct 24 13:35:08.802923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 506/1008] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:08 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:09.438713 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3f6f36b4-bcdf-4ed5-8b8f-32422dba1836 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:09.440050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-3f6f36b4-bcdf-4ed5-8b8f-32422dba1836 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:09.447064 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3f6f36b4-bcdf-4ed5-8b8f-32422dba1836 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:09.447400 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3f6f36b4-bcdf-4ed5-8b8f-32422dba1836 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:09.447904 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3f6f36b4-bcdf-4ed5-8b8f-32422dba1836 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:09.448692 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3f6f36b4-bcdf-4ed5-8b8f-32422dba1836 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:09.449968 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3f6f36b4-bcdf-4ed5-8b8f-32422dba1836 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:09.450854 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3f6f36b4-bcdf-4ed5-8b8f-32422dba1836 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:09.591845 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3f6f36b4-bcdf-4ed5-8b8f-32422dba1836 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:09.600360 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3f6f36b4-bcdf-4ed5-8b8f-32422dba1836 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1263 microversion: 2.1 time: 0.165469 Oct 24 13:35:09.600946 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 503/1009] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:35:09 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:35:09.828191 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-41571028-3d0e-4c0e-b4c6-20ea07ecb3e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:09.828823 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-41571028-3d0e-4c0e-b4c6-20ea07ecb3e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:09.839082 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-41571028-3d0e-4c0e-b4c6-20ea07ecb3e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:09.839623 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-41571028-3d0e-4c0e-b4c6-20ea07ecb3e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:09.841123 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-41571028-3d0e-4c0e-b4c6-20ea07ecb3e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:09.841817 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-41571028-3d0e-4c0e-b4c6-20ea07ecb3e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:09.842716 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-41571028-3d0e-4c0e-b4c6-20ea07ecb3e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:09.843315 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-41571028-3d0e-4c0e-b4c6-20ea07ecb3e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:10.058330 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-41571028-3d0e-4c0e-b4c6-20ea07ecb3e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:10.071907 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-41571028-3d0e-4c0e-b4c6-20ea07ecb3e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:10.073711 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-41571028-3d0e-4c0e-b4c6-20ea07ecb3e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:10.075022 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-41571028-3d0e-4c0e-b4c6-20ea07ecb3e5 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1739 microversion: 2.20 time: 0.251107 Oct 24 13:35:10.076249 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 507/1010] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:09 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:10.624476 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-fc93d7b1-dce8-4cd2-92d2-0e02fbaed0f4 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:10.625098 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-fc93d7b1-dce8-4cd2-92d2-0e02fbaed0f4 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:10.631531 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc93d7b1-dce8-4cd2-92d2-0e02fbaed0f4 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:10.636389 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc93d7b1-dce8-4cd2-92d2-0e02fbaed0f4 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:10.636389 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc93d7b1-dce8-4cd2-92d2-0e02fbaed0f4 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:10.636389 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc93d7b1-dce8-4cd2-92d2-0e02fbaed0f4 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:10.636389 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc93d7b1-dce8-4cd2-92d2-0e02fbaed0f4 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:10.637331 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fc93d7b1-dce8-4cd2-92d2-0e02fbaed0f4 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:10.794520 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fc93d7b1-dce8-4cd2-92d2-0e02fbaed0f4 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:10.802539 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-fc93d7b1-dce8-4cd2-92d2-0e02fbaed0f4 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1263 microversion: 2.1 time: 0.183267 Oct 24 13:35:10.803117 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 504/1011] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:35:10 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1263 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:35:11.102538 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-93eb431a-8315-414d-ac8e-c98c408d5a9d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:11.106664 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-93eb431a-8315-414d-ac8e-c98c408d5a9d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:11.123866 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-93eb431a-8315-414d-ac8e-c98c408d5a9d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:11.128749 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-93eb431a-8315-414d-ac8e-c98c408d5a9d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:11.129283 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-93eb431a-8315-414d-ac8e-c98c408d5a9d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:11.130112 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-93eb431a-8315-414d-ac8e-c98c408d5a9d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:11.130664 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-93eb431a-8315-414d-ac8e-c98c408d5a9d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:11.131148 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-93eb431a-8315-414d-ac8e-c98c408d5a9d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:11.348924 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-93eb431a-8315-414d-ac8e-c98c408d5a9d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:11.364074 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-93eb431a-8315-414d-ac8e-c98c408d5a9d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:11.365382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-93eb431a-8315-414d-ac8e-c98c408d5a9d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:11.366698 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-93eb431a-8315-414d-ac8e-c98c408d5a9d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1739 microversion: 2.20 time: 0.268259 Oct 24 13:35:11.367265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 508/1012] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:11 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1739 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:11.826359 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-6e650396-141e-4a36-b06a-cfa2b95a5603 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:11.828937 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-6e650396-141e-4a36-b06a-cfa2b95a5603 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:11.843847 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6e650396-141e-4a36-b06a-cfa2b95a5603 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:11.844718 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6e650396-141e-4a36-b06a-cfa2b95a5603 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:11.845399 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6e650396-141e-4a36-b06a-cfa2b95a5603 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:11.846187 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6e650396-141e-4a36-b06a-cfa2b95a5603 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:11.846808 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6e650396-141e-4a36-b06a-cfa2b95a5603 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:11.847246 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6e650396-141e-4a36-b06a-cfa2b95a5603 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:11.994022 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6e650396-141e-4a36-b06a-cfa2b95a5603 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:12.003628 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-6e650396-141e-4a36-b06a-cfa2b95a5603 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1263 microversion: 2.1 time: 0.181246 Oct 24 13:35:12.004990 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 505/1013] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:35:11 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1263 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:35:12.363938 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-333dd9f8-e8dc-40fc-8b42-451958b69f71 req-7b67f447-c33f-4adc-8e15-d46eb571c5bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5762454b-33e1-445d-a5e5-be0b4ba78d7b", "name": "network-vif-plugged", "status": "completed", "tag": "d65e0e78-310d-4892-8600-9d032dcae474"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:12.380176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-333dd9f8-e8dc-40fc-8b42-451958b69f71 req-7b67f447-c33f-4adc-8e15-d46eb571c5bd service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:12.381016 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-333dd9f8-e8dc-40fc-8b42-451958b69f71 req-7b67f447-c33f-4adc-8e15-d46eb571c5bd service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:12.381618 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-333dd9f8-e8dc-40fc-8b42-451958b69f71 req-7b67f447-c33f-4adc-8e15-d46eb571c5bd service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:12.395778 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-0d0ad365-ea3e-40be-ab5c-27a90c6bd554 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:12.396575 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-0d0ad365-ea3e-40be-ab5c-27a90c6bd554 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:12.399507 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-333dd9f8-e8dc-40fc-8b42-451958b69f71 req-7b67f447-c33f-4adc-8e15-d46eb571c5bd service nova] Creating event network-vif-plugged:d65e0e78-310d-4892-8600-9d032dcae474 for instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b on hv-cinder-86249 Oct 24 13:35:12.405424 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0d0ad365-ea3e-40be-ab5c-27a90c6bd554 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:12.405928 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0d0ad365-ea3e-40be-ab5c-27a90c6bd554 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:12.406410 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0d0ad365-ea3e-40be-ab5c-27a90c6bd554 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:12.407096 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0d0ad365-ea3e-40be-ab5c-27a90c6bd554 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:12.407552 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0d0ad365-ea3e-40be-ab5c-27a90c6bd554 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:12.407954 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-333dd9f8-e8dc-40fc-8b42-451958b69f71 req-7b67f447-c33f-4adc-8e15-d46eb571c5bd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050398 Oct 24 13:35:12.409082 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 509/1014] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:12.409614 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0d0ad365-ea3e-40be-ab5c-27a90c6bd554 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:12.607103 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-0d0ad365-ea3e-40be-ab5c-27a90c6bd554 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:12.617683 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-0d0ad365-ea3e-40be-ab5c-27a90c6bd554 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:12.622139 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-0d0ad365-ea3e-40be-ab5c-27a90c6bd554 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:12.623242 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-0d0ad365-ea3e-40be-ab5c-27a90c6bd554 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1739 microversion: 2.20 time: 0.231994 Oct 24 13:35:12.644884 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 506/1015] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:12 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:35:13.029750 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-025b2447-c43c-4c59-9531-535837da5051 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:13.030992 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-025b2447-c43c-4c59-9531-535837da5051 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:13.037295 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-025b2447-c43c-4c59-9531-535837da5051 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:13.037766 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-025b2447-c43c-4c59-9531-535837da5051 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:13.038195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-025b2447-c43c-4c59-9531-535837da5051 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:13.038873 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-025b2447-c43c-4c59-9531-535837da5051 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:13.039319 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-025b2447-c43c-4c59-9531-535837da5051 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:13.039733 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-025b2447-c43c-4c59-9531-535837da5051 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:13.173753 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-025b2447-c43c-4c59-9531-535837da5051 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:13.181427 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-025b2447-c43c-4c59-9531-535837da5051 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1263 microversion: 2.1 time: 0.156424 Oct 24 13:35:13.181990 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 510/1016] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:35:13 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:35:13.651263 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c64d44ab-d8ab-4acc-8c84-f3b1bb1abaee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:13.653367 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c64d44ab-d8ab-4acc-8c84-f3b1bb1abaee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:13.660879 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c64d44ab-d8ab-4acc-8c84-f3b1bb1abaee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:13.663776 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c64d44ab-d8ab-4acc-8c84-f3b1bb1abaee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:13.664712 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c64d44ab-d8ab-4acc-8c84-f3b1bb1abaee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:13.668882 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c64d44ab-d8ab-4acc-8c84-f3b1bb1abaee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:13.671177 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c64d44ab-d8ab-4acc-8c84-f3b1bb1abaee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:13.672165 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c64d44ab-d8ab-4acc-8c84-f3b1bb1abaee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:13.857649 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c64d44ab-d8ab-4acc-8c84-f3b1bb1abaee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:13.868223 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c64d44ab-d8ab-4acc-8c84-f3b1bb1abaee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:13.870070 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c64d44ab-d8ab-4acc-8c84-f3b1bb1abaee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:13.872308 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c64d44ab-d8ab-4acc-8c84-f3b1bb1abaee tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1739 microversion: 2.20 time: 0.225168 Oct 24 13:35:13.873436 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 507/1017] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:13 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:14.204605 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c32bee50-2416-4b45-92c7-bae33d62e9ac tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:14.205797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-c32bee50-2416-4b45-92c7-bae33d62e9ac tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:14.209540 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=52 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:14.214021 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c32bee50-2416-4b45-92c7-bae33d62e9ac tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:14.214803 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c32bee50-2416-4b45-92c7-bae33d62e9ac tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:14.214960 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c32bee50-2416-4b45-92c7-bae33d62e9ac tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:14.215623 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c32bee50-2416-4b45-92c7-bae33d62e9ac tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:14.216069 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c32bee50-2416-4b45-92c7-bae33d62e9ac tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:14.216512 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c32bee50-2416-4b45-92c7-bae33d62e9ac tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:14.375443 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c32bee50-2416-4b45-92c7-bae33d62e9ac tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:14.386784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-c32bee50-2416-4b45-92c7-bae33d62e9ac tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1263 microversion: 2.1 time: 0.184505 Oct 24 13:35:14.388194 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 511/1018] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:35:14 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1263 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:35:14.900281 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1c452bfa-f3a0-4348-8dc0-d15bc48227e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:14.900932 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-1c452bfa-f3a0-4348-8dc0-d15bc48227e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:14.903835 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:14.911142 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c452bfa-f3a0-4348-8dc0-d15bc48227e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:14.911832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c452bfa-f3a0-4348-8dc0-d15bc48227e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:14.912479 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c452bfa-f3a0-4348-8dc0-d15bc48227e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:14.913381 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c452bfa-f3a0-4348-8dc0-d15bc48227e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:14.913996 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c452bfa-f3a0-4348-8dc0-d15bc48227e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:14.914608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1c452bfa-f3a0-4348-8dc0-d15bc48227e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:15.070562 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1c452bfa-f3a0-4348-8dc0-d15bc48227e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:15.080729 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1c452bfa-f3a0-4348-8dc0-d15bc48227e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:15.082681 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1c452bfa-f3a0-4348-8dc0-d15bc48227e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:15.083882 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1c452bfa-f3a0-4348-8dc0-d15bc48227e3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1739 microversion: 2.20 time: 0.187650 Oct 24 13:35:15.084542 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 508/1019] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:14 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:15.410913 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-bdccae88-8d25-4be9-b404-c5d34a7a9d38 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:15.411616 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-bdccae88-8d25-4be9-b404-c5d34a7a9d38 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:15.418293 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bdccae88-8d25-4be9-b404-c5d34a7a9d38 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:15.418781 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bdccae88-8d25-4be9-b404-c5d34a7a9d38 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:15.419289 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bdccae88-8d25-4be9-b404-c5d34a7a9d38 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:15.419955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bdccae88-8d25-4be9-b404-c5d34a7a9d38 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:15.420433 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bdccae88-8d25-4be9-b404-c5d34a7a9d38 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:15.420850 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bdccae88-8d25-4be9-b404-c5d34a7a9d38 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:15.579818 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-bdccae88-8d25-4be9-b404-c5d34a7a9d38 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:15.590684 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-bdccae88-8d25-4be9-b404-c5d34a7a9d38 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1449 microversion: 2.1 time: 0.183490 Oct 24 13:35:15.591443 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 512/1020] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:35:15 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1449 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:35:15.626343 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-785b181f-bcca-4e8f-a20b-eeec2c792df5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:15.627056 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-785b181f-bcca-4e8f-a20b-eeec2c792df5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:15.633758 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-785b181f-bcca-4e8f-a20b-eeec2c792df5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:15.634742 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-785b181f-bcca-4e8f-a20b-eeec2c792df5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:15.635265 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-785b181f-bcca-4e8f-a20b-eeec2c792df5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:15.636175 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-785b181f-bcca-4e8f-a20b-eeec2c792df5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:15.638828 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-785b181f-bcca-4e8f-a20b-eeec2c792df5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:15.639487 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-785b181f-bcca-4e8f-a20b-eeec2c792df5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:15.977722 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-785b181f-bcca-4e8f-a20b-eeec2c792df5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:15.988386 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-785b181f-bcca-4e8f-a20b-eeec2c792df5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1449 microversion: 2.1 time: 0.367331 Oct 24 13:35:15.989629 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 509/1021] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:35:15 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1449 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:35:16.121013 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-cdc4bb1d-d5c3-41ad-9d86-b7e604551c13 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:16.121013 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-cdc4bb1d-d5c3-41ad-9d86-b7e604551c13 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:16.121013 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cdc4bb1d-d5c3-41ad-9d86-b7e604551c13 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:16.121013 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cdc4bb1d-d5c3-41ad-9d86-b7e604551c13 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:16.121716 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cdc4bb1d-d5c3-41ad-9d86-b7e604551c13 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:16.121716 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cdc4bb1d-d5c3-41ad-9d86-b7e604551c13 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:16.121716 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cdc4bb1d-d5c3-41ad-9d86-b7e604551c13 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:16.121716 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cdc4bb1d-d5c3-41ad-9d86-b7e604551c13 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:16.283999 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-cdc4bb1d-d5c3-41ad-9d86-b7e604551c13 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:16.296092 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-cdc4bb1d-d5c3-41ad-9d86-b7e604551c13 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:16.302043 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-cdc4bb1d-d5c3-41ad-9d86-b7e604551c13 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:16.303541 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-cdc4bb1d-d5c3-41ad-9d86-b7e604551c13 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1739 microversion: 2.20 time: 0.195939 Oct 24 13:35:16.314154 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 513/1022] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:16 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:17.341100 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-4ebe40b1-8ecc-4a46-9c08-25f79d7fb42f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:17.341712 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-4ebe40b1-8ecc-4a46-9c08-25f79d7fb42f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:17.348305 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4ebe40b1-8ecc-4a46-9c08-25f79d7fb42f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:17.348865 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4ebe40b1-8ecc-4a46-9c08-25f79d7fb42f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:17.349302 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4ebe40b1-8ecc-4a46-9c08-25f79d7fb42f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:17.350107 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4ebe40b1-8ecc-4a46-9c08-25f79d7fb42f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:17.350563 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4ebe40b1-8ecc-4a46-9c08-25f79d7fb42f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:17.350990 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4ebe40b1-8ecc-4a46-9c08-25f79d7fb42f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:17.530548 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-4ebe40b1-8ecc-4a46-9c08-25f79d7fb42f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:17.543695 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-4ebe40b1-8ecc-4a46-9c08-25f79d7fb42f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:17.556996 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-4ebe40b1-8ecc-4a46-9c08-25f79d7fb42f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:17.559785 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-4ebe40b1-8ecc-4a46-9c08-25f79d7fb42f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1739 microversion: 2.20 time: 0.222703 Oct 24 13:35:17.573552 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 510/1023] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:17 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:18.559943 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-d89a6182-d6cc-464b-afec-47ca7221ae48 req-10a4f338-8bcc-4977-b12b-4371672fc6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5762454b-33e1-445d-a5e5-be0b4ba78d7b", "tag": "d65e0e78-310d-4892-8600-9d032dcae474"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:18.574781 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-d89a6182-d6cc-464b-afec-47ca7221ae48 req-10a4f338-8bcc-4977-b12b-4371672fc6b6 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:18.575873 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-d89a6182-d6cc-464b-afec-47ca7221ae48 req-10a4f338-8bcc-4977-b12b-4371672fc6b6 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:18.576556 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-d89a6182-d6cc-464b-afec-47ca7221ae48 req-10a4f338-8bcc-4977-b12b-4371672fc6b6 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:18.591671 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7d2ec23e-516e-420d-8eaa-b94691d4f076 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:18.592413 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7d2ec23e-516e-420d-8eaa-b94691d4f076 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:18.592671 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-d89a6182-d6cc-464b-afec-47ca7221ae48 req-10a4f338-8bcc-4977-b12b-4371672fc6b6 service nova] Creating event network-changed:d65e0e78-310d-4892-8600-9d032dcae474 for instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b on hv-cinder-86249 Oct 24 13:35:18.599773 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-d89a6182-d6cc-464b-afec-47ca7221ae48 req-10a4f338-8bcc-4977-b12b-4371672fc6b6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045485 Oct 24 13:35:18.601165 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 514/1024] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:18.612561 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7d2ec23e-516e-420d-8eaa-b94691d4f076 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:18.613058 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7d2ec23e-516e-420d-8eaa-b94691d4f076 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:18.613509 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7d2ec23e-516e-420d-8eaa-b94691d4f076 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:18.614212 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7d2ec23e-516e-420d-8eaa-b94691d4f076 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:18.614667 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7d2ec23e-516e-420d-8eaa-b94691d4f076 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:18.615097 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7d2ec23e-516e-420d-8eaa-b94691d4f076 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:18.787327 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7d2ec23e-516e-420d-8eaa-b94691d4f076 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:18.800343 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7d2ec23e-516e-420d-8eaa-b94691d4f076 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:18.802125 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7d2ec23e-516e-420d-8eaa-b94691d4f076 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:18.803595 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7d2ec23e-516e-420d-8eaa-b94691d4f076 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1739 microversion: 2.20 time: 0.217335 Oct 24 13:35:18.804751 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 511/1025] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:18 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:19.832313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b200bec4-a8b7-46a5-828d-c2069e72cb49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:19.833014 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b200bec4-a8b7-46a5-828d-c2069e72cb49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:19.841585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b200bec4-a8b7-46a5-828d-c2069e72cb49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:19.842078 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b200bec4-a8b7-46a5-828d-c2069e72cb49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:19.842505 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b200bec4-a8b7-46a5-828d-c2069e72cb49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:19.843202 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b200bec4-a8b7-46a5-828d-c2069e72cb49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:19.843651 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b200bec4-a8b7-46a5-828d-c2069e72cb49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:19.844071 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b200bec4-a8b7-46a5-828d-c2069e72cb49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:20.106601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b200bec4-a8b7-46a5-828d-c2069e72cb49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:20.119599 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b200bec4-a8b7-46a5-828d-c2069e72cb49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:20.121467 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b200bec4-a8b7-46a5-828d-c2069e72cb49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:20.123861 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b200bec4-a8b7-46a5-828d-c2069e72cb49 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1739 microversion: 2.20 time: 0.296265 Oct 24 13:35:20.124857 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 515/1026] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:19 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1739 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:21.151211 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8fee6040-f22b-4fdd-aa0d-395a502c4793 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:21.153011 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8fee6040-f22b-4fdd-aa0d-395a502c4793 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:21.165271 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8fee6040-f22b-4fdd-aa0d-395a502c4793 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:21.165837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8fee6040-f22b-4fdd-aa0d-395a502c4793 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:21.166595 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8fee6040-f22b-4fdd-aa0d-395a502c4793 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:21.167298 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8fee6040-f22b-4fdd-aa0d-395a502c4793 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:21.169200 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8fee6040-f22b-4fdd-aa0d-395a502c4793 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:21.169839 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8fee6040-f22b-4fdd-aa0d-395a502c4793 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:21.313516 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8fee6040-f22b-4fdd-aa0d-395a502c4793 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:21.350848 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8fee6040-f22b-4fdd-aa0d-395a502c4793 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:21.353041 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8fee6040-f22b-4fdd-aa0d-395a502c4793 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:21.354439 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8fee6040-f22b-4fdd-aa0d-395a502c4793 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1739 microversion: 2.20 time: 0.207747 Oct 24 13:35:21.355476 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 512/1027] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:21 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:22.381311 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9378508d-18de-4684-8f8a-d430c15c3bd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:22.381917 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9378508d-18de-4684-8f8a-d430c15c3bd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:22.387898 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9378508d-18de-4684-8f8a-d430c15c3bd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:22.388401 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9378508d-18de-4684-8f8a-d430c15c3bd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:22.388827 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9378508d-18de-4684-8f8a-d430c15c3bd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:22.389502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9378508d-18de-4684-8f8a-d430c15c3bd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:22.389942 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9378508d-18de-4684-8f8a-d430c15c3bd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:22.390350 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9378508d-18de-4684-8f8a-d430c15c3bd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:22.529671 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9378508d-18de-4684-8f8a-d430c15c3bd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:22.538082 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9378508d-18de-4684-8f8a-d430c15c3bd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:22.539579 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9378508d-18de-4684-8f8a-d430c15c3bd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:22.540997 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9378508d-18de-4684-8f8a-d430c15c3bd3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1739 microversion: 2.20 time: 0.163594 Oct 24 13:35:22.541548 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 516/1028] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:22 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:35:23.568570 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e037634c-80bb-48df-9a78-3551fb5a6572 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:23.569173 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e037634c-80bb-48df-9a78-3551fb5a6572 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:23.575696 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e037634c-80bb-48df-9a78-3551fb5a6572 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:23.576168 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e037634c-80bb-48df-9a78-3551fb5a6572 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:23.576624 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e037634c-80bb-48df-9a78-3551fb5a6572 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:23.577298 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e037634c-80bb-48df-9a78-3551fb5a6572 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:23.577739 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e037634c-80bb-48df-9a78-3551fb5a6572 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:23.578153 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e037634c-80bb-48df-9a78-3551fb5a6572 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:23.711942 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e037634c-80bb-48df-9a78-3551fb5a6572 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:23.720422 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e037634c-80bb-48df-9a78-3551fb5a6572 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:23.722091 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e037634c-80bb-48df-9a78-3551fb5a6572 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:23.723399 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e037634c-80bb-48df-9a78-3551fb5a6572 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1721 microversion: 2.20 time: 0.158868 Oct 24 13:35:23.723959 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 513/1029] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:23 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:24.749151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-355c9f67-bdb9-489a-b8ca-6b369d7acd9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:24.749784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-355c9f67-bdb9-489a-b8ca-6b369d7acd9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:24.756154 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-355c9f67-bdb9-489a-b8ca-6b369d7acd9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:24.756693 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-355c9f67-bdb9-489a-b8ca-6b369d7acd9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:24.757116 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-355c9f67-bdb9-489a-b8ca-6b369d7acd9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:24.757781 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-355c9f67-bdb9-489a-b8ca-6b369d7acd9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:24.758221 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-355c9f67-bdb9-489a-b8ca-6b369d7acd9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:24.758658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-355c9f67-bdb9-489a-b8ca-6b369d7acd9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:24.892020 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-355c9f67-bdb9-489a-b8ca-6b369d7acd9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:24.900427 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-355c9f67-bdb9-489a-b8ca-6b369d7acd9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:24.901857 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-355c9f67-bdb9-489a-b8ca-6b369d7acd9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:24.903616 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-355c9f67-bdb9-489a-b8ca-6b369d7acd9b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1721 microversion: 2.20 time: 0.157902 Oct 24 13:35:24.904172 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 517/1030] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:24 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:25.929001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-368d0a18-e270-4879-be29-1739a20dde7f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:25.929614 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-368d0a18-e270-4879-be29-1739a20dde7f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:25.936619 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-368d0a18-e270-4879-be29-1739a20dde7f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:25.937104 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-368d0a18-e270-4879-be29-1739a20dde7f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:25.937536 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-368d0a18-e270-4879-be29-1739a20dde7f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:25.938224 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-368d0a18-e270-4879-be29-1739a20dde7f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:25.938679 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-368d0a18-e270-4879-be29-1739a20dde7f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:25.939103 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-368d0a18-e270-4879-be29-1739a20dde7f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:26.076526 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-368d0a18-e270-4879-be29-1739a20dde7f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:26.085344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-368d0a18-e270-4879-be29-1739a20dde7f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:26.086772 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-368d0a18-e270-4879-be29-1739a20dde7f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:26.088145 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-368d0a18-e270-4879-be29-1739a20dde7f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1724 microversion: 2.20 time: 0.163087 Oct 24 13:35:26.089384 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 514/1031] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:25 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:26.114226 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-38c2c86e-46ed-4c0d-8669-e2a3c79067f0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8070aa16-881e-42c4-8eeb-27f4a52a0e26"}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:26.116619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-38c2c86e-46ed-4c0d-8669-e2a3c79067f0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:26.123791 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-38c2c86e-46ed-4c0d-8669-e2a3c79067f0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:26.124327 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-38c2c86e-46ed-4c0d-8669-e2a3c79067f0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:26.124762 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-38c2c86e-46ed-4c0d-8669-e2a3c79067f0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:26.126297 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-38c2c86e-46ed-4c0d-8669-e2a3c79067f0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:26.126755 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-38c2c86e-46ed-4c0d-8669-e2a3c79067f0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:26.127179 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-38c2c86e-46ed-4c0d-8669-e2a3c79067f0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:26.287172 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-e40dde5e-0688-4b87-ba2a-2c1988c4681a req-2b6e6c7c-519a-473b-a57d-19d66f35ce69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e111014-8ecb-4f6c-865f-a85b64d7cc69", "name": "network-vif-unplugged", "status": "completed", "tag": "13446e7b-9dfe-44f4-b0f9-5884ab770e75"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:26.297631 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-e40dde5e-0688-4b87-ba2a-2c1988c4681a req-2b6e6c7c-519a-473b-a57d-19d66f35ce69 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:26.298200 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-e40dde5e-0688-4b87-ba2a-2c1988c4681a req-2b6e6c7c-519a-473b-a57d-19d66f35ce69 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:26.298516 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-e40dde5e-0688-4b87-ba2a-2c1988c4681a req-2b6e6c7c-519a-473b-a57d-19d66f35ce69 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:26.309109 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.compute.server_external_events [req-e40dde5e-0688-4b87-ba2a-2c1988c4681a req-2b6e6c7c-519a-473b-a57d-19d66f35ce69 service nova] Unable to find a host for instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69. Dropping event network-vif-unplugged {{(pid=119146) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 24 13:35:26.310624 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-e40dde5e-0688-4b87-ba2a-2c1988c4681a req-2b6e6c7c-519a-473b-a57d-19d66f35ce69 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027699 Oct 24 13:35:26.311383 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 515/1032] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 24 13:35:26.811064 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:27.187489 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-38c2c86e-46ed-4c0d-8669-e2a3c79067f0 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "POST /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.077185 Oct 24 13:35:27.188191 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 518/1033] 10.222.0.48 () {62 vars in 1364 bytes} [Mon Oct 24 13:35:26 2022] POST /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69/os-volume_attachments => generated 188 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:35:27.319270 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-36030061-a6bb-46e2-a770-04fc64e5c718 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:27.319816 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-36030061-a6bb-46e2-a770-04fc64e5c718 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:27.326392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-36030061-a6bb-46e2-a770-04fc64e5c718 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:27.326863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-36030061-a6bb-46e2-a770-04fc64e5c718 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:27.327288 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-36030061-a6bb-46e2-a770-04fc64e5c718 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:27.327995 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-36030061-a6bb-46e2-a770-04fc64e5c718 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:27.328467 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-36030061-a6bb-46e2-a770-04fc64e5c718 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:27.329160 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-36030061-a6bb-46e2-a770-04fc64e5c718 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:27.936685 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-36030061-a6bb-46e2-a770-04fc64e5c718 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69/os-volume_attachments/8070aa16-881e-42c4-8eeb-27f4a52a0e26" status: 202 len: 0 microversion: 2.20 time: 0.621231 Oct 24 13:35:27.937287 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 516/1034] 10.222.0.48 () {60 vars in 1457 bytes} [Mon Oct 24 13:35:27 2022] DELETE /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69/os-volume_attachments/8070aa16-881e-42c4-8eeb-27f4a52a0e26 => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:35:28.001292 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b5d0674f-efec-49b4-b1d6-515180ec860d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:28.001927 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b5d0674f-efec-49b4-b1d6-515180ec860d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:28.010221 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b5d0674f-efec-49b4-b1d6-515180ec860d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:28.010902 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b5d0674f-efec-49b4-b1d6-515180ec860d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:28.011335 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b5d0674f-efec-49b4-b1d6-515180ec860d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:28.012027 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b5d0674f-efec-49b4-b1d6-515180ec860d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:28.012910 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b5d0674f-efec-49b4-b1d6-515180ec860d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:28.013530 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b5d0674f-efec-49b4-b1d6-515180ec860d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:28.046705 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b5d0674f-efec-49b4-b1d6-515180ec860d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119145) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 24 13:35:28.293487 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b5d0674f-efec-49b4-b1d6-515180ec860d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "POST /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69/action" status: 202 len: 0 microversion: 2.20 time: 0.296084 Oct 24 13:35:28.294126 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 519/1035] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 24 13:35:27 2022] POST /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 24 13:35:28.302727 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-32d7ca18-3f9d-4793-ab0a-23266ce08e75 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:28.303333 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-32d7ca18-3f9d-4793-ab0a-23266ce08e75 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:28.309295 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-32d7ca18-3f9d-4793-ab0a-23266ce08e75 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:28.309772 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-32d7ca18-3f9d-4793-ab0a-23266ce08e75 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:28.310202 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-32d7ca18-3f9d-4793-ab0a-23266ce08e75 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:28.310956 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-32d7ca18-3f9d-4793-ab0a-23266ce08e75 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:28.311424 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-32d7ca18-3f9d-4793-ab0a-23266ce08e75 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:28.311817 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-32d7ca18-3f9d-4793-ab0a-23266ce08e75 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:28.445953 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-32d7ca18-3f9d-4793-ab0a-23266ce08e75 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:28.448182 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:28.455930 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-32d7ca18-3f9d-4793-ab0a-23266ce08e75 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:28.457408 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-32d7ca18-3f9d-4793-ab0a-23266ce08e75 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:28.468444 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-32d7ca18-3f9d-4793-ab0a-23266ce08e75 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1672 microversion: 2.20 time: 0.159767 Oct 24 13:35:28.468444 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 517/1036] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:28 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:28.956507 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7bc3e3c4-25ff-4e48-8680-584df278770e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:28.956992 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-7bc3e3c4-25ff-4e48-8680-584df278770e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:28.963161 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7bc3e3c4-25ff-4e48-8680-584df278770e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:28.963642 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7bc3e3c4-25ff-4e48-8680-584df278770e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:28.964068 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7bc3e3c4-25ff-4e48-8680-584df278770e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:28.964771 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7bc3e3c4-25ff-4e48-8680-584df278770e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:28.965218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7bc3e3c4-25ff-4e48-8680-584df278770e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:28.965631 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7bc3e3c4-25ff-4e48-8680-584df278770e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:28.990261 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-7bc3e3c4-25ff-4e48-8680-584df278770e tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/ips" status: 200 len: 147 microversion: 2.1 time: 0.037584 Oct 24 13:35:28.990903 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 520/1037] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 24 13:35:28 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:29.486234 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-13b9d759-73b0-4fa2-992a-641ba5921404 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:29.486858 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-13b9d759-73b0-4fa2-992a-641ba5921404 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:29.494254 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-13b9d759-73b0-4fa2-992a-641ba5921404 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:29.494732 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-13b9d759-73b0-4fa2-992a-641ba5921404 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:29.495208 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-13b9d759-73b0-4fa2-992a-641ba5921404 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:29.496049 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-13b9d759-73b0-4fa2-992a-641ba5921404 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:29.496540 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-13b9d759-73b0-4fa2-992a-641ba5921404 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:29.496961 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-13b9d759-73b0-4fa2-992a-641ba5921404 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:29.644823 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-13b9d759-73b0-4fa2-992a-641ba5921404 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:29.657050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-13b9d759-73b0-4fa2-992a-641ba5921404 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:29.657050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-13b9d759-73b0-4fa2-992a-641ba5921404 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:29.657354 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-13b9d759-73b0-4fa2-992a-641ba5921404 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1672 microversion: 2.20 time: 0.176004 Oct 24 13:35:29.657885 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 518/1038] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:29 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1672 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:30.657737 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-735351a1-0520-4510-a76c-b69f4523b115 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90d80485-404a-46b1-9f9f-a69b9a91537c"}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:30.660211 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-735351a1-0520-4510-a76c-b69f4523b115 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:30.666583 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-735351a1-0520-4510-a76c-b69f4523b115 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:30.667061 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-735351a1-0520-4510-a76c-b69f4523b115 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:30.667514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-735351a1-0520-4510-a76c-b69f4523b115 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:30.668202 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-735351a1-0520-4510-a76c-b69f4523b115 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:30.668678 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-735351a1-0520-4510-a76c-b69f4523b115 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:30.669094 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-735351a1-0520-4510-a76c-b69f4523b115 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:30.685873 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-cb52ff65-78cf-4fa8-aaf8-52bbbf4da563 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:30.687191 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-cb52ff65-78cf-4fa8-aaf8-52bbbf4da563 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:30.698459 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb52ff65-78cf-4fa8-aaf8-52bbbf4da563 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:30.698956 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb52ff65-78cf-4fa8-aaf8-52bbbf4da563 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:30.699405 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb52ff65-78cf-4fa8-aaf8-52bbbf4da563 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:30.700433 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb52ff65-78cf-4fa8-aaf8-52bbbf4da563 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:30.701403 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb52ff65-78cf-4fa8-aaf8-52bbbf4da563 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:30.701828 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cb52ff65-78cf-4fa8-aaf8-52bbbf4da563 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:30.836935 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-cb52ff65-78cf-4fa8-aaf8-52bbbf4da563 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:30.846991 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-cb52ff65-78cf-4fa8-aaf8-52bbbf4da563 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:30.848413 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-cb52ff65-78cf-4fa8-aaf8-52bbbf4da563 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:30.849514 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-cb52ff65-78cf-4fa8-aaf8-52bbbf4da563 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1674 microversion: 2.20 time: 0.170245 Oct 24 13:35:30.850260 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 519/1039] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:30 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:31.523069 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-735351a1-0520-4510-a76c-b69f4523b115 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "POST /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.869845 Oct 24 13:35:31.523747 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 521/1040] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 24 13:35:30 2022] POST /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments => generated 194 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:31.875186 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8fae90da-2d94-4a15-81ed-0eea36329f88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:31.875798 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8fae90da-2d94-4a15-81ed-0eea36329f88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:31.882503 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8fae90da-2d94-4a15-81ed-0eea36329f88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:31.882986 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8fae90da-2d94-4a15-81ed-0eea36329f88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:31.883418 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8fae90da-2d94-4a15-81ed-0eea36329f88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:31.884108 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8fae90da-2d94-4a15-81ed-0eea36329f88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:31.884585 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8fae90da-2d94-4a15-81ed-0eea36329f88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:31.885008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8fae90da-2d94-4a15-81ed-0eea36329f88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:32.018526 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8fae90da-2d94-4a15-81ed-0eea36329f88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:32.026743 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8fae90da-2d94-4a15-81ed-0eea36329f88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:32.028187 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8fae90da-2d94-4a15-81ed-0eea36329f88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:32.029409 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8fae90da-2d94-4a15-81ed-0eea36329f88 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.158331 Oct 24 13:35:32.030522 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 520/1041] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:31 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:33.057320 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b9e9a5e6-19f7-447c-ae85-c7eb676f3c9c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:33.058099 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b9e9a5e6-19f7-447c-ae85-c7eb676f3c9c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:33.064896 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b9e9a5e6-19f7-447c-ae85-c7eb676f3c9c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:33.065375 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b9e9a5e6-19f7-447c-ae85-c7eb676f3c9c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:33.065807 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b9e9a5e6-19f7-447c-ae85-c7eb676f3c9c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:33.066497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b9e9a5e6-19f7-447c-ae85-c7eb676f3c9c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:33.066950 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b9e9a5e6-19f7-447c-ae85-c7eb676f3c9c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:33.067366 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b9e9a5e6-19f7-447c-ae85-c7eb676f3c9c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:33.210555 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b9e9a5e6-19f7-447c-ae85-c7eb676f3c9c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:33.219525 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b9e9a5e6-19f7-447c-ae85-c7eb676f3c9c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:33.220995 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b9e9a5e6-19f7-447c-ae85-c7eb676f3c9c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:33.222164 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b9e9a5e6-19f7-447c-ae85-c7eb676f3c9c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.169746 Oct 24 13:35:33.222740 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 522/1042] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:33 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:34.249417 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-23a860e7-565a-46aa-aca4-c0a84046162b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:34.250656 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-23a860e7-565a-46aa-aca4-c0a84046162b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:34.257626 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-23a860e7-565a-46aa-aca4-c0a84046162b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:34.258113 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-23a860e7-565a-46aa-aca4-c0a84046162b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:34.258584 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-23a860e7-565a-46aa-aca4-c0a84046162b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:34.259297 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-23a860e7-565a-46aa-aca4-c0a84046162b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:34.259751 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-23a860e7-565a-46aa-aca4-c0a84046162b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:34.260174 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-23a860e7-565a-46aa-aca4-c0a84046162b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:34.398390 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-23a860e7-565a-46aa-aca4-c0a84046162b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:34.407124 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-23a860e7-565a-46aa-aca4-c0a84046162b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:34.408588 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-23a860e7-565a-46aa-aca4-c0a84046162b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:34.409748 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-23a860e7-565a-46aa-aca4-c0a84046162b tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.164949 Oct 24 13:35:34.410308 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 521/1043] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:34 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:35.435612 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-adf6bf7a-0720-42dd-a043-b9863e1fe99a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:35.436738 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-adf6bf7a-0720-42dd-a043-b9863e1fe99a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:35.443405 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-adf6bf7a-0720-42dd-a043-b9863e1fe99a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:35.443902 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-adf6bf7a-0720-42dd-a043-b9863e1fe99a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:35.444358 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-adf6bf7a-0720-42dd-a043-b9863e1fe99a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:35.445037 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-adf6bf7a-0720-42dd-a043-b9863e1fe99a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:35.445483 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-adf6bf7a-0720-42dd-a043-b9863e1fe99a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:35.445901 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-adf6bf7a-0720-42dd-a043-b9863e1fe99a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:35.581687 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-adf6bf7a-0720-42dd-a043-b9863e1fe99a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:35.590140 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-adf6bf7a-0720-42dd-a043-b9863e1fe99a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:35.591590 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-adf6bf7a-0720-42dd-a043-b9863e1fe99a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:35.592803 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-adf6bf7a-0720-42dd-a043-b9863e1fe99a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.161063 Oct 24 13:35:35.593347 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 523/1044] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:35 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:36.618364 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a688f849-8948-4e56-a495-8316a4811910 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:36.618970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a688f849-8948-4e56-a495-8316a4811910 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:36.626102 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a688f849-8948-4e56-a495-8316a4811910 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:36.626232 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a688f849-8948-4e56-a495-8316a4811910 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:36.626585 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a688f849-8948-4e56-a495-8316a4811910 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:36.627260 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a688f849-8948-4e56-a495-8316a4811910 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:36.627707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a688f849-8948-4e56-a495-8316a4811910 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:36.628209 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a688f849-8948-4e56-a495-8316a4811910 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:36.762072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a688f849-8948-4e56-a495-8316a4811910 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:36.775807 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a688f849-8948-4e56-a495-8316a4811910 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:36.778241 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a688f849-8948-4e56-a495-8316a4811910 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:36.779542 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a688f849-8948-4e56-a495-8316a4811910 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.165126 Oct 24 13:35:36.780952 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 522/1045] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:36 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:37.806639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7845e7be-3513-4e69-bc9b-b56b987f8f0c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:37.807232 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-7845e7be-3513-4e69-bc9b-b56b987f8f0c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:37.813994 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7845e7be-3513-4e69-bc9b-b56b987f8f0c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:37.814536 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7845e7be-3513-4e69-bc9b-b56b987f8f0c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:37.814952 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7845e7be-3513-4e69-bc9b-b56b987f8f0c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:37.815684 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7845e7be-3513-4e69-bc9b-b56b987f8f0c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:37.816164 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7845e7be-3513-4e69-bc9b-b56b987f8f0c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:37.816614 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7845e7be-3513-4e69-bc9b-b56b987f8f0c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:37.947984 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-7845e7be-3513-4e69-bc9b-b56b987f8f0c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:37.956617 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-7845e7be-3513-4e69-bc9b-b56b987f8f0c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:37.958143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-7845e7be-3513-4e69-bc9b-b56b987f8f0c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:37.959304 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-7845e7be-3513-4e69-bc9b-b56b987f8f0c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.156577 Oct 24 13:35:37.959864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 524/1046] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:37 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:38.986831 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bc3e8bcb-50eb-4c4a-81d5-80c69a1c824f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:38.987447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bc3e8bcb-50eb-4c4a-81d5-80c69a1c824f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:38.995359 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bc3e8bcb-50eb-4c4a-81d5-80c69a1c824f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:38.995359 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bc3e8bcb-50eb-4c4a-81d5-80c69a1c824f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:38.995359 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bc3e8bcb-50eb-4c4a-81d5-80c69a1c824f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:38.995824 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bc3e8bcb-50eb-4c4a-81d5-80c69a1c824f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:38.996546 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bc3e8bcb-50eb-4c4a-81d5-80c69a1c824f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:38.997125 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bc3e8bcb-50eb-4c4a-81d5-80c69a1c824f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:39.144483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-bc3e8bcb-50eb-4c4a-81d5-80c69a1c824f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:39.152604 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-bc3e8bcb-50eb-4c4a-81d5-80c69a1c824f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:39.155877 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-bc3e8bcb-50eb-4c4a-81d5-80c69a1c824f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:39.155877 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-bc3e8bcb-50eb-4c4a-81d5-80c69a1c824f tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.173058 Oct 24 13:35:39.155877 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 523/1047] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:38 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:40.181606 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-315d4e98-4006-4091-abc5-e7de4d8849fa tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:40.182227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-315d4e98-4006-4091-abc5-e7de4d8849fa tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:40.196341 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-315d4e98-4006-4091-abc5-e7de4d8849fa tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:40.197419 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-315d4e98-4006-4091-abc5-e7de4d8849fa tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:40.198520 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-315d4e98-4006-4091-abc5-e7de4d8849fa tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:40.199458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-315d4e98-4006-4091-abc5-e7de4d8849fa tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:40.200173 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-315d4e98-4006-4091-abc5-e7de4d8849fa tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:40.200634 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-315d4e98-4006-4091-abc5-e7de4d8849fa tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:40.347593 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-315d4e98-4006-4091-abc5-e7de4d8849fa tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:40.356438 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-315d4e98-4006-4091-abc5-e7de4d8849fa tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:40.362382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-315d4e98-4006-4091-abc5-e7de4d8849fa tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:40.362382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-315d4e98-4006-4091-abc5-e7de4d8849fa tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.181541 Oct 24 13:35:40.362382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 525/1048] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:40 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:41.386071 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-12e8de8d-6c16-4062-be87-0a9e9248f974 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:41.386747 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-12e8de8d-6c16-4062-be87-0a9e9248f974 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:41.395075 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-12e8de8d-6c16-4062-be87-0a9e9248f974 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:41.395559 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-12e8de8d-6c16-4062-be87-0a9e9248f974 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:41.396194 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-12e8de8d-6c16-4062-be87-0a9e9248f974 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:41.397259 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-12e8de8d-6c16-4062-be87-0a9e9248f974 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:41.397721 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-12e8de8d-6c16-4062-be87-0a9e9248f974 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:41.398136 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-12e8de8d-6c16-4062-be87-0a9e9248f974 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:41.538839 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-12e8de8d-6c16-4062-be87-0a9e9248f974 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:41.548199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-12e8de8d-6c16-4062-be87-0a9e9248f974 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:41.549715 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-12e8de8d-6c16-4062-be87-0a9e9248f974 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:41.551621 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-12e8de8d-6c16-4062-be87-0a9e9248f974 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.169360 Oct 24 13:35:41.552348 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 524/1049] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:41 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:42.578476 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-52cb4387-2ae9-4fbb-8a9a-69c9e507cb6d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:42.579252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-52cb4387-2ae9-4fbb-8a9a-69c9e507cb6d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:42.592926 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-52cb4387-2ae9-4fbb-8a9a-69c9e507cb6d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:42.594020 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-52cb4387-2ae9-4fbb-8a9a-69c9e507cb6d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:42.594462 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-52cb4387-2ae9-4fbb-8a9a-69c9e507cb6d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:42.595162 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-52cb4387-2ae9-4fbb-8a9a-69c9e507cb6d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:42.595615 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-52cb4387-2ae9-4fbb-8a9a-69c9e507cb6d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:42.596120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-52cb4387-2ae9-4fbb-8a9a-69c9e507cb6d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:42.731168 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-52cb4387-2ae9-4fbb-8a9a-69c9e507cb6d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:42.739611 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-52cb4387-2ae9-4fbb-8a9a-69c9e507cb6d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:42.741051 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-52cb4387-2ae9-4fbb-8a9a-69c9e507cb6d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:42.742211 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-52cb4387-2ae9-4fbb-8a9a-69c9e507cb6d tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.168542 Oct 24 13:35:42.742769 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 526/1050] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:42 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:43.769208 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-61419527-c213-4203-832f-191de10e9357 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:43.770832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-61419527-c213-4203-832f-191de10e9357 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:43.776729 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-61419527-c213-4203-832f-191de10e9357 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:43.777339 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-61419527-c213-4203-832f-191de10e9357 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:43.778590 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-61419527-c213-4203-832f-191de10e9357 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:43.779405 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-61419527-c213-4203-832f-191de10e9357 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:43.779863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-61419527-c213-4203-832f-191de10e9357 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:43.780302 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-61419527-c213-4203-832f-191de10e9357 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:43.913992 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-61419527-c213-4203-832f-191de10e9357 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:43.923784 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-61419527-c213-4203-832f-191de10e9357 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:43.925232 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-61419527-c213-4203-832f-191de10e9357 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:43.926382 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-61419527-c213-4203-832f-191de10e9357 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.161568 Oct 24 13:35:43.926942 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 525/1051] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:43 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:44.951987 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7022cbe6-40e9-409d-af3d-450e42a1711c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:44.952666 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-7022cbe6-40e9-409d-af3d-450e42a1711c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:44.954980 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:44.959594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7022cbe6-40e9-409d-af3d-450e42a1711c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:44.960065 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7022cbe6-40e9-409d-af3d-450e42a1711c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:44.960521 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7022cbe6-40e9-409d-af3d-450e42a1711c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:44.961194 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7022cbe6-40e9-409d-af3d-450e42a1711c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:44.961637 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7022cbe6-40e9-409d-af3d-450e42a1711c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:44.962046 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7022cbe6-40e9-409d-af3d-450e42a1711c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:45.094601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-7022cbe6-40e9-409d-af3d-450e42a1711c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:45.102701 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-7022cbe6-40e9-409d-af3d-450e42a1711c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:45.104131 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-7022cbe6-40e9-409d-af3d-450e42a1711c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:45.105359 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-7022cbe6-40e9-409d-af3d-450e42a1711c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.157584 Oct 24 13:35:45.105938 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 527/1052] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:44 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:46.131732 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7e833153-62bd-44a6-a2a3-9f2f2339ad80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:46.132358 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7e833153-62bd-44a6-a2a3-9f2f2339ad80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:46.134875 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=36 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:46.139928 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7e833153-62bd-44a6-a2a3-9f2f2339ad80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:46.140447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7e833153-62bd-44a6-a2a3-9f2f2339ad80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:46.140870 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7e833153-62bd-44a6-a2a3-9f2f2339ad80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:46.142115 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7e833153-62bd-44a6-a2a3-9f2f2339ad80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:46.142559 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7e833153-62bd-44a6-a2a3-9f2f2339ad80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:46.142981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7e833153-62bd-44a6-a2a3-9f2f2339ad80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:46.282756 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7e833153-62bd-44a6-a2a3-9f2f2339ad80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:46.291008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7e833153-62bd-44a6-a2a3-9f2f2339ad80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:46.292461 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7e833153-62bd-44a6-a2a3-9f2f2339ad80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:46.293668 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7e833153-62bd-44a6-a2a3-9f2f2339ad80 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.166067 Oct 24 13:35:46.294229 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 526/1053] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:46 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:47.319699 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-1381e4a6-6443-4dd3-ad02-d114849e4834 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:47.320245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-1381e4a6-6443-4dd3-ad02-d114849e4834 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:47.326944 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1381e4a6-6443-4dd3-ad02-d114849e4834 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:47.327419 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1381e4a6-6443-4dd3-ad02-d114849e4834 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:47.327849 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1381e4a6-6443-4dd3-ad02-d114849e4834 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:47.328560 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1381e4a6-6443-4dd3-ad02-d114849e4834 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:47.329534 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1381e4a6-6443-4dd3-ad02-d114849e4834 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:47.329953 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1381e4a6-6443-4dd3-ad02-d114849e4834 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:47.475243 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1381e4a6-6443-4dd3-ad02-d114849e4834 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:47.484097 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1381e4a6-6443-4dd3-ad02-d114849e4834 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:47.485550 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1381e4a6-6443-4dd3-ad02-d114849e4834 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:47.486725 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-1381e4a6-6443-4dd3-ad02-d114849e4834 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.171175 Oct 24 13:35:47.487310 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 528/1054] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:47 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:48.513222 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-58ec8e0d-b070-40d4-b2ae-e7a637ee6a08 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:48.513821 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-58ec8e0d-b070-40d4-b2ae-e7a637ee6a08 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:48.520362 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-58ec8e0d-b070-40d4-b2ae-e7a637ee6a08 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:48.520842 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-58ec8e0d-b070-40d4-b2ae-e7a637ee6a08 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:48.521269 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-58ec8e0d-b070-40d4-b2ae-e7a637ee6a08 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:48.521949 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-58ec8e0d-b070-40d4-b2ae-e7a637ee6a08 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:48.522396 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-58ec8e0d-b070-40d4-b2ae-e7a637ee6a08 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:48.522813 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-58ec8e0d-b070-40d4-b2ae-e7a637ee6a08 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:48.660601 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-58ec8e0d-b070-40d4-b2ae-e7a637ee6a08 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:48.668904 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-58ec8e0d-b070-40d4-b2ae-e7a637ee6a08 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:48.670357 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-58ec8e0d-b070-40d4-b2ae-e7a637ee6a08 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:48.671528 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-58ec8e0d-b070-40d4-b2ae-e7a637ee6a08 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.162305 Oct 24 13:35:48.672088 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 527/1055] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:48 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:49.699327 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-3c8f48aa-dbfa-4796-99a7-dbae8b4b821c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:49.700279 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-3c8f48aa-dbfa-4796-99a7-dbae8b4b821c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:49.707383 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3c8f48aa-dbfa-4796-99a7-dbae8b4b821c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:49.707860 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3c8f48aa-dbfa-4796-99a7-dbae8b4b821c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:49.708311 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3c8f48aa-dbfa-4796-99a7-dbae8b4b821c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:49.709025 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3c8f48aa-dbfa-4796-99a7-dbae8b4b821c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:49.709498 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3c8f48aa-dbfa-4796-99a7-dbae8b4b821c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:49.709915 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3c8f48aa-dbfa-4796-99a7-dbae8b4b821c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:49.848917 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-3c8f48aa-dbfa-4796-99a7-dbae8b4b821c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:49.857087 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-3c8f48aa-dbfa-4796-99a7-dbae8b4b821c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:49.858556 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-3c8f48aa-dbfa-4796-99a7-dbae8b4b821c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:49.859731 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-3c8f48aa-dbfa-4796-99a7-dbae8b4b821c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.164623 Oct 24 13:35:49.860346 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 529/1056] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:49 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:50.806594 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-fd0c7c44-aada-4b23-bc05-add666c8d726 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:50.808973 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-fd0c7c44-aada-4b23-bc05-add666c8d726 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:50.817664 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fd0c7c44-aada-4b23-bc05-add666c8d726 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:50.818155 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fd0c7c44-aada-4b23-bc05-add666c8d726 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:50.818598 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fd0c7c44-aada-4b23-bc05-add666c8d726 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:50.819291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fd0c7c44-aada-4b23-bc05-add666c8d726 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:50.819857 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fd0c7c44-aada-4b23-bc05-add666c8d726 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:50.820209 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fd0c7c44-aada-4b23-bc05-add666c8d726 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:50.851227 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-fd0c7c44-aada-4b23-bc05-add666c8d726 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048592 Oct 24 13:35:50.851798 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 528/1057] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 24 13:35:50 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:50.862896 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-d7aa5bda-99a7-42b1-8692-0d85b825adba tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:50.863467 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-d7aa5bda-99a7-42b1-8692-0d85b825adba tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:50.870261 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d7aa5bda-99a7-42b1-8692-0d85b825adba tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:50.870738 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d7aa5bda-99a7-42b1-8692-0d85b825adba tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:50.871345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d7aa5bda-99a7-42b1-8692-0d85b825adba tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:50.872031 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d7aa5bda-99a7-42b1-8692-0d85b825adba tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:50.872508 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d7aa5bda-99a7-42b1-8692-0d85b825adba tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:50.872922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d7aa5bda-99a7-42b1-8692-0d85b825adba tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:50.885987 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e8def598-8b87-4a81-a095-ff9396aa0dcd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:50.886634 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e8def598-8b87-4a81-a095-ff9396aa0dcd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:50.892519 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e8def598-8b87-4a81-a095-ff9396aa0dcd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:50.893006 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e8def598-8b87-4a81-a095-ff9396aa0dcd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:50.893441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e8def598-8b87-4a81-a095-ff9396aa0dcd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:50.894134 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e8def598-8b87-4a81-a095-ff9396aa0dcd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:50.894591 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e8def598-8b87-4a81-a095-ff9396aa0dcd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:50.895017 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e8def598-8b87-4a81-a095-ff9396aa0dcd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:50.902518 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-d7aa5bda-99a7-42b1-8692-0d85b825adba tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments/90d80485-404a-46b1-9f9f-a69b9a91537c" status: 200 len: 194 microversion: 2.1 time: 0.044042 Oct 24 13:35:50.908226 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 530/1058] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Oct 24 13:35:50 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments/90d80485-404a-46b1-9f9f-a69b9a91537c => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:51.047969 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e8def598-8b87-4a81-a095-ff9396aa0dcd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:51.057818 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e8def598-8b87-4a81-a095-ff9396aa0dcd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:51.063149 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e8def598-8b87-4a81-a095-ff9396aa0dcd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:51.063149 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e8def598-8b87-4a81-a095-ff9396aa0dcd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.178335 Oct 24 13:35:51.063149 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 529/1059] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:50 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:35:52.087038 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-2db569c5-226e-4ee5-95e4-06be2e4369a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:52.087648 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-2db569c5-226e-4ee5-95e4-06be2e4369a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:52.094059 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2db569c5-226e-4ee5-95e4-06be2e4369a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:52.094541 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2db569c5-226e-4ee5-95e4-06be2e4369a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:52.095000 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2db569c5-226e-4ee5-95e4-06be2e4369a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:52.095631 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2db569c5-226e-4ee5-95e4-06be2e4369a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:52.096076 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2db569c5-226e-4ee5-95e4-06be2e4369a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:52.096516 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2db569c5-226e-4ee5-95e4-06be2e4369a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:52.227626 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-2db569c5-226e-4ee5-95e4-06be2e4369a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:52.236141 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-2db569c5-226e-4ee5-95e4-06be2e4369a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:52.237644 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-2db569c5-226e-4ee5-95e4-06be2e4369a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:52.238780 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-2db569c5-226e-4ee5-95e4-06be2e4369a7 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.155652 Oct 24 13:35:52.239351 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 531/1060] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:52 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:52.445769 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-b881e6cd-411b-4805-88ff-5370426b3188 req-d31c889c-3ff2-44ba-a382-d59e47da0983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e111014-8ecb-4f6c-865f-a85b64d7cc69", "name": "network-vif-plugged", "status": "completed", "tag": "13446e7b-9dfe-44f4-b0f9-5884ab770e75"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:52.458331 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-b881e6cd-411b-4805-88ff-5370426b3188 req-d31c889c-3ff2-44ba-a382-d59e47da0983 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:52.458813 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-b881e6cd-411b-4805-88ff-5370426b3188 req-d31c889c-3ff2-44ba-a382-d59e47da0983 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:52.459240 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-b881e6cd-411b-4805-88ff-5370426b3188 req-d31c889c-3ff2-44ba-a382-d59e47da0983 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:52.470536 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-b881e6cd-411b-4805-88ff-5370426b3188 req-d31c889c-3ff2-44ba-a382-d59e47da0983 service nova] Creating event network-vif-plugged:13446e7b-9dfe-44f4-b0f9-5884ab770e75 for instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 on hv-cinder-86249 Oct 24 13:35:52.475993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-b881e6cd-411b-4805-88ff-5370426b3188 req-d31c889c-3ff2-44ba-a382-d59e47da0983 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034396 Oct 24 13:35:52.476638 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 530/1061] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:52.502442 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-cb38424b-281c-477e-a2ad-79f695aaba65 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1f01c58-2285-4334-a028-4b0c22e24fab"}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:52.505211 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-cb38424b-281c-477e-a2ad-79f695aaba65 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:52.511308 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cb38424b-281c-477e-a2ad-79f695aaba65 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:52.511808 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cb38424b-281c-477e-a2ad-79f695aaba65 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:52.512244 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cb38424b-281c-477e-a2ad-79f695aaba65 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:52.512970 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cb38424b-281c-477e-a2ad-79f695aaba65 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:52.513422 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cb38424b-281c-477e-a2ad-79f695aaba65 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:52.513847 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cb38424b-281c-477e-a2ad-79f695aaba65 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:52.588248 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:53.265620 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-851a7903-aee6-4315-85f6-7b7bd05e8606 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:53.266317 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-851a7903-aee6-4315-85f6-7b7bd05e8606 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:53.272955 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-851a7903-aee6-4315-85f6-7b7bd05e8606 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:53.273435 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-851a7903-aee6-4315-85f6-7b7bd05e8606 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:53.273865 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-851a7903-aee6-4315-85f6-7b7bd05e8606 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:53.274568 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-851a7903-aee6-4315-85f6-7b7bd05e8606 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:53.275011 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-851a7903-aee6-4315-85f6-7b7bd05e8606 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:53.275427 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-851a7903-aee6-4315-85f6-7b7bd05e8606 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:53.340440 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-cb38424b-281c-477e-a2ad-79f695aaba65 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "POST /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.842385 Oct 24 13:35:53.341269 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 532/1062] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 24 13:35:52 2022] POST /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments => generated 194 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:53.422067 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-851a7903-aee6-4315-85f6-7b7bd05e8606 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:53.430974 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-851a7903-aee6-4315-85f6-7b7bd05e8606 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:53.432463 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-851a7903-aee6-4315-85f6-7b7bd05e8606 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:53.433613 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-851a7903-aee6-4315-85f6-7b7bd05e8606 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.172477 Oct 24 13:35:53.434163 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 531/1063] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:53 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:35:54.462085 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-d6c3299f-b8de-40da-9c16-29ce762639fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:54.463413 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-d6c3299f-b8de-40da-9c16-29ce762639fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:54.471039 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d6c3299f-b8de-40da-9c16-29ce762639fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:54.475524 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d6c3299f-b8de-40da-9c16-29ce762639fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:54.475524 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d6c3299f-b8de-40da-9c16-29ce762639fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:54.475524 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d6c3299f-b8de-40da-9c16-29ce762639fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:54.475524 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d6c3299f-b8de-40da-9c16-29ce762639fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:54.475910 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d6c3299f-b8de-40da-9c16-29ce762639fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:54.611549 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-d6c3299f-b8de-40da-9c16-29ce762639fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:54.619770 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-d6c3299f-b8de-40da-9c16-29ce762639fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:54.621219 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-d6c3299f-b8de-40da-9c16-29ce762639fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:54.622361 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-d6c3299f-b8de-40da-9c16-29ce762639fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.165042 Oct 24 13:35:54.622908 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 533/1064] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:54 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:55.648687 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-77dc9c1d-58dd-4808-aff2-c30a6c2c96fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:55.649289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-77dc9c1d-58dd-4808-aff2-c30a6c2c96fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:55.655814 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-77dc9c1d-58dd-4808-aff2-c30a6c2c96fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:55.656312 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-77dc9c1d-58dd-4808-aff2-c30a6c2c96fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:55.656740 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-77dc9c1d-58dd-4808-aff2-c30a6c2c96fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:55.657413 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-77dc9c1d-58dd-4808-aff2-c30a6c2c96fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:55.658361 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-77dc9c1d-58dd-4808-aff2-c30a6c2c96fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:55.658771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-77dc9c1d-58dd-4808-aff2-c30a6c2c96fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:55.793880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-77dc9c1d-58dd-4808-aff2-c30a6c2c96fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:55.802999 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-77dc9c1d-58dd-4808-aff2-c30a6c2c96fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:55.804515 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-77dc9c1d-58dd-4808-aff2-c30a6c2c96fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:55.805674 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-77dc9c1d-58dd-4808-aff2-c30a6c2c96fb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1730 microversion: 2.20 time: 0.160951 Oct 24 13:35:55.806230 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 532/1065] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:55 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:56.831759 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-97c32c74-6a09-415d-8f27-441e0b42470a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:56.832336 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-97c32c74-6a09-415d-8f27-441e0b42470a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:35:56.838723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-97c32c74-6a09-415d-8f27-441e0b42470a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:56.839188 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-97c32c74-6a09-415d-8f27-441e0b42470a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:56.839609 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-97c32c74-6a09-415d-8f27-441e0b42470a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:56.840295 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-97c32c74-6a09-415d-8f27-441e0b42470a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:35:56.840741 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-97c32c74-6a09-415d-8f27-441e0b42470a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:35:56.841152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-97c32c74-6a09-415d-8f27-441e0b42470a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:35:56.967704 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-97c32c74-6a09-415d-8f27-441e0b42470a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:56.975660 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-97c32c74-6a09-415d-8f27-441e0b42470a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:56.977117 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-97c32c74-6a09-415d-8f27-441e0b42470a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:35:56.978261 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-97c32c74-6a09-415d-8f27-441e0b42470a tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1717 microversion: 2.20 time: 0.150553 Oct 24 13:35:56.978811 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 534/1066] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:35:56 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1717 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:36:01.960150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-921baae3-61f8-4869-ae9a-9d3fa0ada632 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:01.962421 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-921baae3-61f8-4869-ae9a-9d3fa0ada632 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:01.968935 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-921baae3-61f8-4869-ae9a-9d3fa0ada632 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:01.969411 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-921baae3-61f8-4869-ae9a-9d3fa0ada632 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:01.969858 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-921baae3-61f8-4869-ae9a-9d3fa0ada632 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:01.971118 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-921baae3-61f8-4869-ae9a-9d3fa0ada632 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:01.971565 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-921baae3-61f8-4869-ae9a-9d3fa0ada632 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:01.971983 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-921baae3-61f8-4869-ae9a-9d3fa0ada632 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:01.974436 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=88 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:02.002134 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-921baae3-61f8-4869-ae9a-9d3fa0ada632 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045830 Oct 24 13:36:02.002669 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 533/1067] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 24 13:36:01 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:36:02.144184 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-d300eb97-c24a-4438-b820-ef5d55cb2787 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:02.144723 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-d300eb97-c24a-4438-b820-ef5d55cb2787 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:02.151320 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d300eb97-c24a-4438-b820-ef5d55cb2787 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:02.151799 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d300eb97-c24a-4438-b820-ef5d55cb2787 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:02.152228 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d300eb97-c24a-4438-b820-ef5d55cb2787 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:02.152936 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d300eb97-c24a-4438-b820-ef5d55cb2787 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:02.153387 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d300eb97-c24a-4438-b820-ef5d55cb2787 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:02.153808 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d300eb97-c24a-4438-b820-ef5d55cb2787 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:02.184877 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-d300eb97-c24a-4438-b820-ef5d55cb2787 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments/90d80485-404a-46b1-9f9f-a69b9a91537c" status: 200 len: 194 microversion: 2.1 time: 0.045061 Oct 24 13:36:02.185453 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 535/1068] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Oct 24 13:36:02 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments/90d80485-404a-46b1-9f9f-a69b9a91537c => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:36:02.196308 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-311584d0-9a37-422e-b177-cc2702137351 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:02.196745 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-311584d0-9a37-422e-b177-cc2702137351 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:02.202995 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-311584d0-9a37-422e-b177-cc2702137351 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:02.203475 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-311584d0-9a37-422e-b177-cc2702137351 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:02.203909 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-311584d0-9a37-422e-b177-cc2702137351 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:02.205123 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-311584d0-9a37-422e-b177-cc2702137351 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:02.205574 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-311584d0-9a37-422e-b177-cc2702137351 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:02.205996 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-311584d0-9a37-422e-b177-cc2702137351 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:02.286264 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.objects.instance [None req-311584d0-9a37-422e-b177-cc2702137351 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lazy-loading 'services' on Instance uuid 937175c3-4262-4fe8-acfc-69bd009df2ac {{(pid=119146) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:36:02.451641 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-311584d0-9a37-422e-b177-cc2702137351 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "DELETE /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments/90d80485-404a-46b1-9f9f-a69b9a91537c" status: 202 len: 0 microversion: 2.1 time: 0.256872 Oct 24 13:36:02.451641 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 534/1069] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 24 13:36:02 2022] DELETE /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments/90d80485-404a-46b1-9f9f-a69b9a91537c => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:36:04.632583 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0d5ba47b-4c7c-419c-8dfc-9054ded40c83 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:04.633155 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0d5ba47b-4c7c-419c-8dfc-9054ded40c83 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:04.639605 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d5ba47b-4c7c-419c-8dfc-9054ded40c83 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:04.640317 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d5ba47b-4c7c-419c-8dfc-9054ded40c83 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:04.640524 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d5ba47b-4c7c-419c-8dfc-9054ded40c83 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:04.641279 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d5ba47b-4c7c-419c-8dfc-9054ded40c83 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:04.641719 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d5ba47b-4c7c-419c-8dfc-9054ded40c83 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:04.642209 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0d5ba47b-4c7c-419c-8dfc-9054ded40c83 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:04.672454 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0d5ba47b-4c7c-419c-8dfc-9054ded40c83 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments/b1f01c58-2285-4334-a028-4b0c22e24fab" status: 200 len: 194 microversion: 2.1 time: 0.044092 Oct 24 13:36:04.673274 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 536/1070] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Oct 24 13:36:04 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments/b1f01c58-2285-4334-a028-4b0c22e24fab => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:36:04.685361 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3e44ca18-d912-440a-8547-c07dcf22a190 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:04.686016 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-3e44ca18-d912-440a-8547-c07dcf22a190 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:04.692880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3e44ca18-d912-440a-8547-c07dcf22a190 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:04.693412 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3e44ca18-d912-440a-8547-c07dcf22a190 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:04.693849 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3e44ca18-d912-440a-8547-c07dcf22a190 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:04.694579 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3e44ca18-d912-440a-8547-c07dcf22a190 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:04.695039 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3e44ca18-d912-440a-8547-c07dcf22a190 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:04.695465 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3e44ca18-d912-440a-8547-c07dcf22a190 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:04.774879 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.objects.instance [None req-3e44ca18-d912-440a-8547-c07dcf22a190 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lazy-loading 'services' on Instance uuid 937175c3-4262-4fe8-acfc-69bd009df2ac {{(pid=119146) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:36:04.968873 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3e44ca18-d912-440a-8547-c07dcf22a190 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "DELETE /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments/b1f01c58-2285-4334-a028-4b0c22e24fab" status: 202 len: 0 microversion: 2.1 time: 0.288084 Oct 24 13:36:04.969406 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 535/1071] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 24 13:36:04 2022] DELETE /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments/b1f01c58-2285-4334-a028-4b0c22e24fab => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:36:07.195525 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-54757752-aca8-4e33-863f-196f1d682a23 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:07.197879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-54757752-aca8-4e33-863f-196f1d682a23 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:07.204508 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-54757752-aca8-4e33-863f-196f1d682a23 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:07.205569 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-54757752-aca8-4e33-863f-196f1d682a23 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:07.206009 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-54757752-aca8-4e33-863f-196f1d682a23 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:07.206678 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-54757752-aca8-4e33-863f-196f1d682a23 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:07.207119 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-54757752-aca8-4e33-863f-196f1d682a23 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:07.207529 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-54757752-aca8-4e33-863f-196f1d682a23 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:07.235291 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-54757752-aca8-4e33-863f-196f1d682a23 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043609 Oct 24 13:36:07.235764 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 537/1072] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 24 13:36:07 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:36:07.349877 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9beb2850-ba4a-4828-9622-1ba17f7e8785 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:07.352205 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-9beb2850-ba4a-4828-9622-1ba17f7e8785 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:07.358269 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9beb2850-ba4a-4828-9622-1ba17f7e8785 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:07.358746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9beb2850-ba4a-4828-9622-1ba17f7e8785 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:07.359174 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9beb2850-ba4a-4828-9622-1ba17f7e8785 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:07.359854 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9beb2850-ba4a-4828-9622-1ba17f7e8785 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:07.360330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9beb2850-ba4a-4828-9622-1ba17f7e8785 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:07.360753 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9beb2850-ba4a-4828-9622-1ba17f7e8785 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:07.391553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9beb2850-ba4a-4828-9622-1ba17f7e8785 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046439 Oct 24 13:36:07.392106 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 536/1073] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 24 13:36:07 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:36:07.454178 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b48b4696-ba6a-4a1a-8882-b6d18475ffc3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:07.454667 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b48b4696-ba6a-4a1a-8882-b6d18475ffc3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:07.462689 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b48b4696-ba6a-4a1a-8882-b6d18475ffc3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:07.463160 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b48b4696-ba6a-4a1a-8882-b6d18475ffc3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:07.463582 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b48b4696-ba6a-4a1a-8882-b6d18475ffc3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:07.464259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b48b4696-ba6a-4a1a-8882-b6d18475ffc3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:07.464730 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b48b4696-ba6a-4a1a-8882-b6d18475ffc3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:07.465143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b48b4696-ba6a-4a1a-8882-b6d18475ffc3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:07.489599 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b48b4696-ba6a-4a1a-8882-b6d18475ffc3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Going to try to terminate instance {{(pid=119145) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:36:07.735641 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b48b4696-ba6a-4a1a-8882-b6d18475ffc3 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "DELETE /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 204 len: 0 microversion: 2.1 time: 0.284960 Oct 24 13:36:07.736843 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 538/1074] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:36:07 2022] DELETE /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:36:07.745012 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-0ce46cd8-42b1-4f62-811e-16d01ba7f831 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:07.745566 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-0ce46cd8-42b1-4f62-811e-16d01ba7f831 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:07.751465 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0ce46cd8-42b1-4f62-811e-16d01ba7f831 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:07.751946 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0ce46cd8-42b1-4f62-811e-16d01ba7f831 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:07.752512 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0ce46cd8-42b1-4f62-811e-16d01ba7f831 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:07.753205 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0ce46cd8-42b1-4f62-811e-16d01ba7f831 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:07.753656 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0ce46cd8-42b1-4f62-811e-16d01ba7f831 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:07.754076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0ce46cd8-42b1-4f62-811e-16d01ba7f831 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:07.884544 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-0ce46cd8-42b1-4f62-811e-16d01ba7f831 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:07.892235 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-0ce46cd8-42b1-4f62-811e-16d01ba7f831 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 200 len: 1674 microversion: 2.1 time: 0.151189 Oct 24 13:36:07.892812 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 537/1075] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:07 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:08.916746 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9dab1d6d-8373-4b3a-aca0-6c30a891ed50 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:08.917475 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9dab1d6d-8373-4b3a-aca0-6c30a891ed50 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:08.923754 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9dab1d6d-8373-4b3a-aca0-6c30a891ed50 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:08.924226 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9dab1d6d-8373-4b3a-aca0-6c30a891ed50 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:08.924693 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9dab1d6d-8373-4b3a-aca0-6c30a891ed50 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:08.925372 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9dab1d6d-8373-4b3a-aca0-6c30a891ed50 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:08.925822 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9dab1d6d-8373-4b3a-aca0-6c30a891ed50 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:08.926239 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9dab1d6d-8373-4b3a-aca0-6c30a891ed50 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:09.057290 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9dab1d6d-8373-4b3a-aca0-6c30a891ed50 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:09.065871 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9dab1d6d-8373-4b3a-aca0-6c30a891ed50 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 200 len: 1674 microversion: 2.1 time: 0.153268 Oct 24 13:36:09.066439 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 539/1076] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:08 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:10.090005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bf10b8bd-86dc-40a7-97a9-87a538769701 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:10.090625 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bf10b8bd-86dc-40a7-97a9-87a538769701 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:10.097633 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bf10b8bd-86dc-40a7-97a9-87a538769701 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:10.098115 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bf10b8bd-86dc-40a7-97a9-87a538769701 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:10.098549 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bf10b8bd-86dc-40a7-97a9-87a538769701 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:10.099239 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bf10b8bd-86dc-40a7-97a9-87a538769701 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:10.099692 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bf10b8bd-86dc-40a7-97a9-87a538769701 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:10.100112 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bf10b8bd-86dc-40a7-97a9-87a538769701 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:10.229025 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-bf10b8bd-86dc-40a7-97a9-87a538769701 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:10.236762 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-bf10b8bd-86dc-40a7-97a9-87a538769701 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 200 len: 1674 microversion: 2.1 time: 0.150601 Oct 24 13:36:10.237526 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 538/1077] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:10 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:11.076807 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-c50ff4d4-f2d8-4bce-be37-edf9490c860e req-97a81399-6dc3-426b-8ad0-096e8b5dbe45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "937175c3-4262-4fe8-acfc-69bd009df2ac", "name": "network-vif-deleted", "tag": "28395180-00b3-4e86-b35a-bac15da8261a"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:36:11.087203 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-c50ff4d4-f2d8-4bce-be37-edf9490c860e req-97a81399-6dc3-426b-8ad0-096e8b5dbe45 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:11.087728 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-c50ff4d4-f2d8-4bce-be37-edf9490c860e req-97a81399-6dc3-426b-8ad0-096e8b5dbe45 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:11.088168 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-c50ff4d4-f2d8-4bce-be37-edf9490c860e req-97a81399-6dc3-426b-8ad0-096e8b5dbe45 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:11.102918 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-c50ff4d4-f2d8-4bce-be37-edf9490c860e req-97a81399-6dc3-426b-8ad0-096e8b5dbe45 service nova] Creating event network-vif-deleted:28395180-00b3-4e86-b35a-bac15da8261a for instance 937175c3-4262-4fe8-acfc-69bd009df2ac on hv-cinder-86249 Oct 24 13:36:11.108438 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-c50ff4d4-f2d8-4bce-be37-edf9490c860e req-97a81399-6dc3-426b-8ad0-096e8b5dbe45 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035558 Oct 24 13:36:11.109103 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 540/1078] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:36:11.259922 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-2114f199-6d1f-49db-b285-e17d46f09b9b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:11.262116 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-2114f199-6d1f-49db-b285-e17d46f09b9b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:11.271371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2114f199-6d1f-49db-b285-e17d46f09b9b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:11.271916 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2114f199-6d1f-49db-b285-e17d46f09b9b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:11.272378 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2114f199-6d1f-49db-b285-e17d46f09b9b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:11.273080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2114f199-6d1f-49db-b285-e17d46f09b9b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:11.274420 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2114f199-6d1f-49db-b285-e17d46f09b9b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:11.275015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2114f199-6d1f-49db-b285-e17d46f09b9b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:11.355976 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-2114f199-6d1f-49db-b285-e17d46f09b9b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dd5e32e4a642c8ac9e44310e0a6a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3faf7ad1fea4ab8b08c98a10491ec11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:11.364722 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-2114f199-6d1f-49db-b285-e17d46f09b9b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 200 len: 1322 microversion: 2.1 time: 0.108977 Oct 24 13:36:11.365425 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 539/1079] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:11 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 1322 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:12.389301 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8e5283c0-9d33-41da-b28a-9e5a7c525249 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:12.389916 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-8e5283c0-9d33-41da-b28a-9e5a7c525249 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:12.396671 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8e5283c0-9d33-41da-b28a-9e5a7c525249 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:12.397147 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8e5283c0-9d33-41da-b28a-9e5a7c525249 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:12.397579 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8e5283c0-9d33-41da-b28a-9e5a7c525249 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:12.398262 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8e5283c0-9d33-41da-b28a-9e5a7c525249 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:12.398717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8e5283c0-9d33-41da-b28a-9e5a7c525249 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:12.399132 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8e5283c0-9d33-41da-b28a-9e5a7c525249 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:12.412257 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-8e5283c0-9d33-41da-b28a-9e5a7c525249 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] HTTP exception thrown: Instance 937175c3-4262-4fe8-acfc-69bd009df2ac could not be found. Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8e5283c0-9d33-41da-b28a-9e5a7c525249 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Request method failure captured: Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac HTTP/1.1 Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpJKlKQjYs1MmspmjNUNKBpfayBoamaJVHfF9IBf4UVrmv8R451ig0EBZGkiw1R5T9MDBDRdVCcuBAwSC8u0xJLyxwFDc7FlNVXURIj5NKNfyHSmjkEh3wDsDA6nnyqxx0_yhFQqucG_16aMkjN5TyPzXeWFLlNMREn-TrBii6In0Do Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: e3faf7ad1fea4ab8b08c98a10491ec11 Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-AttachVolumeTestJSON-323460550 Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:36:12.413893 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:36:12.415522 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e3faf7ad1fea4ab8b08c98a10491ec11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3faf7ad1fea4ab8b08c98a10491ec11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3faf7ad1fea4ab8b08c98a10491ec11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e3faf7ad1fea4ab8b08c98a10491ec11"}]}] Oct 24 13:36:12.415522 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-AttachVolumeTestJSON-323460550 Oct 24 13:36:12.415522 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: e3faf7ad1fea4ab8b08c98a10491ec11 Oct 24 13:36:12.415522 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-AttachVolumeTestJSON-323460550 Oct 24 13:36:12.415522 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-AttachVolumeTestJSON-323460550-project Oct 24 13:36:12.415522 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:36:12.415522 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:36:12.415522 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: e0dd5e32e4a642c8ac9e44310e0a6a5b Oct 24 13:36:12.415522 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-AttachVolumeTestJSON-323460550-project Oct 24 13:36:12.415522 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:36:12.415522 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance 937175c3-4262-4fe8-acfc-69bd009df2ac could not be found. Oct 24 13:36:12.415522 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': '937175c3-4262-4fe8-acfc-69bd009df2ac'} Oct 24 13:36:12.416500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:36:12.416500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:36:12.416500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:36:12.416500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:36:12.416500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:36:12.416500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:36:12.416500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:36:12.416500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:36:12.416500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:36:12.416500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:36:12.416500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 937175c3-4262-4fe8-acfc-69bd009df2ac could not be found. Oct 24 13:36:12.416500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:36:12.416500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:36:12.416500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:36:12.416500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:36:12.416500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:36:12.416500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:36:12.416500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:36:12.416500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:36:12.416500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:36:12.418058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:36:12.418058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:36:12.418058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:36:12.418058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:36:12.418058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:36:12.418058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:36:12.418058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:36:12.418058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 937175c3-4262-4fe8-acfc-69bd009df2ac could not be found. Oct 24 13:36:12.418058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:36:12.418058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:36:12.418058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:36:12.418058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:36:12.418058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:36:12.418058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:36:12.418058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:36:12.418058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:36:12.418058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 937175c3-4262-4fe8-acfc-69bd009df2ac could not be found. Oct 24 13:36:12.418058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:36:12.419495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8e5283c0-9d33-41da-b28a-9e5a7c525249 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Returning 404 to user: Instance 937175c3-4262-4fe8-acfc-69bd009df2ac could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:36:12.419495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-8e5283c0-9d33-41da-b28a-9e5a7c525249 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 404 len: 111 microversion: 2.1 time: 0.031023 Oct 24 13:36:12.419495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 541/1080] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:12 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:36:12.425532 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ede5ec63-ab60-44bf-b770-2dc77d5f238b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '.version_select at 0x7f17a83c0550>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:12.502917 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-ede5ec63-ab60-44bf-b770-2dc77d5f238b tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1262094304" status: 202 len: 0 microversion: 2.1 time: 0.080508 Oct 24 13:36:12.503495 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 540/1081] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 24 13:36:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1262094304 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:36:15.749315 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-048d2a4a-6377-4d6b-a620-b7fa1d552c88 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:15.750506 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-048d2a4a-6377-4d6b-a620-b7fa1d552c88 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:15.772887 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:15.774302 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-048d2a4a-6377-4d6b-a620-b7fa1d552c88 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:15.774776 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-048d2a4a-6377-4d6b-a620-b7fa1d552c88 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:15.775200 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-048d2a4a-6377-4d6b-a620-b7fa1d552c88 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:15.775936 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-048d2a4a-6377-4d6b-a620-b7fa1d552c88 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:15.776470 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-048d2a4a-6377-4d6b-a620-b7fa1d552c88 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:15.776766 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-048d2a4a-6377-4d6b-a620-b7fa1d552c88 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:15.792428 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-048d2a4a-6377-4d6b-a620-b7fa1d552c88 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] HTTP exception thrown: Instance 937175c3-4262-4fe8-acfc-69bd009df2ac could not be found. Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-048d2a4a-6377-4d6b-a620-b7fa1d552c88 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Request method failure captured: Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: DELETE /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac HTTP/1.1 Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpJKlKQjYs1MmspmjNUNKBpfayBoamaJVHfF9IBf4UVrmv8R451ig0EBZGkiw1R5T9MDBDRdVCcuBAwSC8u0xJLyxwFDc7FlNVXURIj5NKNfyHSmjkEh3wDsDA6nnyqxx0_yhFQqucG_16aMkjN5TyPzXeWFLlNMREn-TrBii6In0Do Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: e3faf7ad1fea4ab8b08c98a10491ec11 Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-AttachVolumeTestJSON-323460550 Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:36:15.793978 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:36:15.795459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e3faf7ad1fea4ab8b08c98a10491ec11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3faf7ad1fea4ab8b08c98a10491ec11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3faf7ad1fea4ab8b08c98a10491ec11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e3faf7ad1fea4ab8b08c98a10491ec11"}]}] Oct 24 13:36:15.795459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-AttachVolumeTestJSON-323460550 Oct 24 13:36:15.795459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: e3faf7ad1fea4ab8b08c98a10491ec11 Oct 24 13:36:15.795459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-AttachVolumeTestJSON-323460550 Oct 24 13:36:15.795459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-AttachVolumeTestJSON-323460550-project Oct 24 13:36:15.795459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:36:15.795459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:36:15.795459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: e0dd5e32e4a642c8ac9e44310e0a6a5b Oct 24 13:36:15.795459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-AttachVolumeTestJSON-323460550-project Oct 24 13:36:15.795459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:36:15.795459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance 937175c3-4262-4fe8-acfc-69bd009df2ac could not be found. Oct 24 13:36:15.795459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': '937175c3-4262-4fe8-acfc-69bd009df2ac'} Oct 24 13:36:15.796252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:36:15.796252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:36:15.796252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:36:15.796252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:36:15.796252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:36:15.796252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:36:15.796252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:36:15.796252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:36:15.796252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:36:15.796252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:36:15.796252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 937175c3-4262-4fe8-acfc-69bd009df2ac could not be found. Oct 24 13:36:15.796252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:36:15.796252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:36:15.796252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:36:15.796252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:36:15.796252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:36:15.796252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:36:15.796252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:36:15.796252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:36:15.796252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:36:15.803182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:36:15.803182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:36:15.803182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:36:15.803182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:36:15.803182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:36:15.803182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:36:15.803182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:36:15.803182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:36:15.803182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:36:15.803182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 937175c3-4262-4fe8-acfc-69bd009df2ac could not be found. Oct 24 13:36:15.803182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:36:15.803182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:36:15.803182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:36:15.803182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:36:15.803182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:36:15.803182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:36:15.803182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:36:15.803182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:36:15.803182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 937175c3-4262-4fe8-acfc-69bd009df2ac could not be found. Oct 24 13:36:15.803182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:36:15.804502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-048d2a4a-6377-4d6b-a620-b7fa1d552c88 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Returning 404 to user: Instance 937175c3-4262-4fe8-acfc-69bd009df2ac could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:36:15.804502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-048d2a4a-6377-4d6b-a620-b7fa1d552c88 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "DELETE /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 404 len: 111 microversion: 2.1 time: 0.050086 Oct 24 13:36:15.804502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 542/1082] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:36:15 2022] DELETE /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:36:15.805382 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e7fea79d-8650-40f5-82e1-d4f54cd61151 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:15.805995 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e7fea79d-8650-40f5-82e1-d4f54cd61151 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: 937175c3-4262-4fe8-acfc-69bd009df2ac] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:15.812572 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e7fea79d-8650-40f5-82e1-d4f54cd61151 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:15.813051 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e7fea79d-8650-40f5-82e1-d4f54cd61151 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:15.813637 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e7fea79d-8650-40f5-82e1-d4f54cd61151 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:15.814332 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e7fea79d-8650-40f5-82e1-d4f54cd61151 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:15.814784 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e7fea79d-8650-40f5-82e1-d4f54cd61151 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:15.815208 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e7fea79d-8650-40f5-82e1-d4f54cd61151 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:15.828360 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-e7fea79d-8650-40f5-82e1-d4f54cd61151 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] HTTP exception thrown: Instance 937175c3-4262-4fe8-acfc-69bd009df2ac could not be found. Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e7fea79d-8650-40f5-82e1-d4f54cd61151 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Request method failure captured: Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac HTTP/1.1 Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpJKlKQjYs1MmspmjNUNKBpfayBoamaJVHfF9IBf4UVrmv8R451ig0EBZGkiw1R5T9MDBDRdVCcuBAwSC8u0xJLyxwFDc7FlNVXURIj5NKNfyHSmjkEh3wDsDA6nnyqxx0_yhFQqucG_16aMkjN5TyPzXeWFLlNMREn-TrBii6In0Do Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: e3faf7ad1fea4ab8b08c98a10491ec11 Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-AttachVolumeTestJSON-323460550 Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:36:15.829981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:36:15.831819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e3faf7ad1fea4ab8b08c98a10491ec11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3faf7ad1fea4ab8b08c98a10491ec11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3faf7ad1fea4ab8b08c98a10491ec11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e3faf7ad1fea4ab8b08c98a10491ec11"}]}] Oct 24 13:36:15.831819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-AttachVolumeTestJSON-323460550 Oct 24 13:36:15.831819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: e3faf7ad1fea4ab8b08c98a10491ec11 Oct 24 13:36:15.831819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-AttachVolumeTestJSON-323460550 Oct 24 13:36:15.831819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-AttachVolumeTestJSON-323460550-project Oct 24 13:36:15.831819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:36:15.831819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:36:15.831819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: e0dd5e32e4a642c8ac9e44310e0a6a5b Oct 24 13:36:15.831819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-AttachVolumeTestJSON-323460550-project Oct 24 13:36:15.831819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:36:15.831819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Instance 937175c3-4262-4fe8-acfc-69bd009df2ac could not be found. Oct 24 13:36:15.831819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': '937175c3-4262-4fe8-acfc-69bd009df2ac'} Oct 24 13:36:15.832795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:36:15.832795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:36:15.832795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:36:15.832795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:36:15.832795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:36:15.832795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:36:15.832795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:36:15.832795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:36:15.832795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:36:15.832795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:36:15.832795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 937175c3-4262-4fe8-acfc-69bd009df2ac could not be found. Oct 24 13:36:15.832795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:36:15.832795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:36:15.832795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:36:15.832795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:36:15.832795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:36:15.832795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:36:15.832795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:36:15.832795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:36:15.832795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:36:15.834457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:36:15.834457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:36:15.834457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:36:15.834457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:36:15.834457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:36:15.834457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:36:15.834457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:36:15.834457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 937175c3-4262-4fe8-acfc-69bd009df2ac could not be found. Oct 24 13:36:15.834457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:36:15.834457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:36:15.834457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:36:15.834457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:36:15.834457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:36:15.834457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:36:15.834457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:36:15.834457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:36:15.834457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 937175c3-4262-4fe8-acfc-69bd009df2ac could not be found. Oct 24 13:36:15.834457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:36:15.835851 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e7fea79d-8650-40f5-82e1-d4f54cd61151 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Returning 404 to user: Instance 937175c3-4262-4fe8-acfc-69bd009df2ac could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:36:15.835851 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e7fea79d-8650-40f5-82e1-d4f54cd61151 tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac" status: 404 len: 111 microversion: 2.1 time: 0.031122 Oct 24 13:36:15.835851 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 541/1083] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:15 2022] GET /compute/v2.1/servers/937175c3-4262-4fe8-acfc-69bd009df2ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:36:17.108429 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8029b02e-eb22-44fd-a539-10a89912a60d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:17.108945 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-8029b02e-eb22-44fd-a539-10a89912a60d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:17.116117 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8029b02e-eb22-44fd-a539-10a89912a60d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:17.116611 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8029b02e-eb22-44fd-a539-10a89912a60d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:17.117035 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8029b02e-eb22-44fd-a539-10a89912a60d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:17.117715 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8029b02e-eb22-44fd-a539-10a89912a60d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:17.118159 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8029b02e-eb22-44fd-a539-10a89912a60d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:17.118571 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8029b02e-eb22-44fd-a539-10a89912a60d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:17.132324 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-8029b02e-eb22-44fd-a539-10a89912a60d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] HTTP exception thrown: Instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa could not be found. Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8029b02e-eb22-44fd-a539-10a89912a60d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Request method failure captured: Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: DELETE /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa HTTP/1.1 Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpJKlKQjYs1MmspmjNUNKBpfayBoamaJVHfF9IBf4UVrmv8R451ig0EBZGkiw1R5T9MDBDRdVCcuBAwSC8u0xJLyxwFDc7FlNVXURIj5NKNfyHSmjkEh3wDsDA6nnyqxx0_yhFQqucG_16aMkjN5TyPzXeWFLlNMREn-TrBii6In0Do Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: e3faf7ad1fea4ab8b08c98a10491ec11 Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-AttachVolumeTestJSON-323460550 Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:36:17.133923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:36:17.135502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e3faf7ad1fea4ab8b08c98a10491ec11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3faf7ad1fea4ab8b08c98a10491ec11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3faf7ad1fea4ab8b08c98a10491ec11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e3faf7ad1fea4ab8b08c98a10491ec11"}]}] Oct 24 13:36:17.135502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-AttachVolumeTestJSON-323460550 Oct 24 13:36:17.135502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: e3faf7ad1fea4ab8b08c98a10491ec11 Oct 24 13:36:17.135502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-AttachVolumeTestJSON-323460550 Oct 24 13:36:17.135502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-AttachVolumeTestJSON-323460550-project Oct 24 13:36:17.135502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:36:17.135502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:36:17.135502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: e0dd5e32e4a642c8ac9e44310e0a6a5b Oct 24 13:36:17.135502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-AttachVolumeTestJSON-323460550-project Oct 24 13:36:17.135502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:36:17.135502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa could not be found. Oct 24 13:36:17.135502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': 'a568b3c6-b364-45d0-a9fa-2bdbde43ccaa'} Oct 24 13:36:17.136627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:36:17.136627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:36:17.136627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:36:17.136627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:36:17.136627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:36:17.136627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:36:17.136627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:36:17.136627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:36:17.136627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:36:17.136627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:36:17.136627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa could not be found. Oct 24 13:36:17.136627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:36:17.136627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:36:17.136627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:36:17.136627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:36:17.136627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:36:17.136627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:36:17.136627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:36:17.136627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:36:17.136627 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:36:17.138095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:36:17.138095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:36:17.138095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:36:17.138095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:36:17.138095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:36:17.138095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:36:17.138095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:36:17.138095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:36:17.138095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:36:17.138095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa could not be found. Oct 24 13:36:17.138095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:36:17.138095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:36:17.138095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:36:17.138095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:36:17.138095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:36:17.138095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:36:17.138095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:36:17.138095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:36:17.138095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa could not be found. Oct 24 13:36:17.138095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:36:17.139638 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8029b02e-eb22-44fd-a539-10a89912a60d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Returning 404 to user: Instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:36:17.139638 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-8029b02e-eb22-44fd-a539-10a89912a60d tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 404 len: 111 microversion: 2.1 time: 0.031044 Oct 24 13:36:17.139638 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 543/1084] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:36:17 2022] DELETE /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:36:17.143624 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-de04f9d0-c2b6-4d3e-a483-de427028ac7a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:17.144233 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-de04f9d0-c2b6-4d3e-a483-de427028ac7a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] [instance: a568b3c6-b364-45d0-a9fa-2bdbde43ccaa] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:17.146632 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:17.151428 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-de04f9d0-c2b6-4d3e-a483-de427028ac7a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:17.161945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-de04f9d0-c2b6-4d3e-a483-de427028ac7a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:17.161945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-de04f9d0-c2b6-4d3e-a483-de427028ac7a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:17.161945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-de04f9d0-c2b6-4d3e-a483-de427028ac7a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:17.161945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-de04f9d0-c2b6-4d3e-a483-de427028ac7a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:17.162374 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-de04f9d0-c2b6-4d3e-a483-de427028ac7a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:17.166974 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-de04f9d0-c2b6-4d3e-a483-de427028ac7a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] HTTP exception thrown: Instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa could not be found. Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-de04f9d0-c2b6-4d3e-a483-de427028ac7a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Request method failure captured: Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa HTTP/1.1 Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpJKlKQjYs1MmspmjNUNKBpfayBoamaJVHfF9IBf4UVrmv8R451ig0EBZGkiw1R5T9MDBDRdVCcuBAwSC8u0xJLyxwFDc7FlNVXURIj5NKNfyHSmjkEh3wDsDA6nnyqxx0_yhFQqucG_16aMkjN5TyPzXeWFLlNMREn-TrBii6In0Do Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: e3faf7ad1fea4ab8b08c98a10491ec11 Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-AttachVolumeTestJSON-323460550 Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:36:17.168553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:36:17.170159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e3faf7ad1fea4ab8b08c98a10491ec11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3faf7ad1fea4ab8b08c98a10491ec11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3faf7ad1fea4ab8b08c98a10491ec11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e3faf7ad1fea4ab8b08c98a10491ec11"}]}] Oct 24 13:36:17.170159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-AttachVolumeTestJSON-323460550 Oct 24 13:36:17.170159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: e3faf7ad1fea4ab8b08c98a10491ec11 Oct 24 13:36:17.170159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-AttachVolumeTestJSON-323460550 Oct 24 13:36:17.170159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-AttachVolumeTestJSON-323460550-project Oct 24 13:36:17.170159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:36:17.170159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:36:17.170159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: e0dd5e32e4a642c8ac9e44310e0a6a5b Oct 24 13:36:17.170159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-AttachVolumeTestJSON-323460550-project Oct 24 13:36:17.170159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:36:17.170159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa could not be found. Oct 24 13:36:17.170159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': 'a568b3c6-b364-45d0-a9fa-2bdbde43ccaa'} Oct 24 13:36:17.171069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:36:17.171069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:36:17.171069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:36:17.171069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:36:17.171069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:36:17.171069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:36:17.171069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:36:17.171069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:36:17.171069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:36:17.171069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:36:17.171069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa could not be found. Oct 24 13:36:17.171069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:36:17.171069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:36:17.171069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:36:17.171069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:36:17.171069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:36:17.171069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:36:17.171069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:36:17.171069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:36:17.171069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:36:17.172398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:36:17.172398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:36:17.172398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:36:17.172398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:36:17.172398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:36:17.172398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:36:17.172398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:36:17.172398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa could not be found. Oct 24 13:36:17.172398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:36:17.172398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:36:17.172398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:36:17.172398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:36:17.172398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:36:17.172398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:36:17.172398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:36:17.172398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:36:17.172398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa could not be found. Oct 24 13:36:17.172398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:36:17.173638 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-de04f9d0-c2b6-4d3e-a483-de427028ac7a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] Returning 404 to user: Instance a568b3c6-b364-45d0-a9fa-2bdbde43ccaa could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:36:17.173638 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-de04f9d0-c2b6-4d3e-a483-de427028ac7a tempest-AttachVolumeTestJSON-323460550 tempest-AttachVolumeTestJSON-323460550-project] 10.222.0.48 "GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa" status: 404 len: 111 microversion: 2.1 time: 0.030249 Oct 24 13:36:17.173638 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 542/1085] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:17 2022] GET /compute/v2.1/servers/a568b3c6-b364-45d0-a9fa-2bdbde43ccaa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:36:27.820376 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=3 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:27.821701 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:27.937730 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-3d59dde2-7378-447c-94a0-87e56c7e3684 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Action: 'create', calling method: .version_select at 0x7f17a808c3a0>, body: {"keypair": {"name": "tempest-keypair-1572055490", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3nP/BeUW9Ri/50hKIKerN7U2i31RI2CK8puT3NQDu60rpFmc4EZB1TTopDMY2GQ1+qH9s+R5vfR0ul2c0KGa/pUeHAaV1dIjAiR/b1H3V828XVdm1SUtYq25Ta/6mKeg=="}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:36:27.953542 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-3d59dde2-7378-447c-94a0-87e56c7e3684 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Getting quotas for project 0a7896472f034eb4b3b028d528cfbac0. Resources: {'key_pairs'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:36:27.957527 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-3d59dde2-7378-447c-94a0-87e56c7e3684 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Getting quotas for user 54fcced6d8d943608b940d1dab001540 and project 0a7896472f034eb4b3b028d528cfbac0. Resources: {'key_pairs'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:36:28.039768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-3d59dde2-7378-447c-94a0-87e56c7e3684 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.224562 Oct 24 13:36:28.040429 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 544/1086] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 24 13:36:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:36:30.146411 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bf0988b8-8533-4e28-a0d9-e6a4ce0a3d93 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-411484067", "imageRef": "1a874490-179e-412c-895e-52b16935c04c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b68375da-958f-473f-9389-64a90da42e86"}], "security_groups": [{"name": "tempest-securitygroup--1175372563"}], "key_name": "tempest-keypair-1572055490", "user_data": "}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:36:30.155458 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:30.260595 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.network.neutron [None req-bf0988b8-8533-4e28-a0d9-e6a4ce0a3d93 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] validate_networks() for [('b68375da-958f-473f-9389-64a90da42e86', None, None, None, None, None)] {{(pid=119146) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:36:30.982482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-bf0988b8-8533-4e28-a0d9-e6a4ce0a3d93 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Flavor limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:36:30.983350 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-bf0988b8-8533-4e28-a0d9-e6a4ce0a3d93 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Image limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:36:30.983998 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-bf0988b8-8533-4e28-a0d9-e6a4ce0a3d93 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Flavor pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:36:30.984639 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-bf0988b8-8533-4e28-a0d9-e6a4ce0a3d93 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Image pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:36:30.985048 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-bf0988b8-8533-4e28-a0d9-e6a4ce0a3d93 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:36:30.994538 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bf0988b8-8533-4e28-a0d9-e6a4ce0a3d93 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:30.995022 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bf0988b8-8533-4e28-a0d9-e6a4ce0a3d93 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:30.995450 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bf0988b8-8533-4e28-a0d9-e6a4ce0a3d93 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:30.996375 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bf0988b8-8533-4e28-a0d9-e6a4ce0a3d93 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:30.997021 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bf0988b8-8533-4e28-a0d9-e6a4ce0a3d93 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:30.997935 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bf0988b8-8533-4e28-a0d9-e6a4ce0a3d93 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:31.016164 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-bf0988b8-8533-4e28-a0d9-e6a4ce0a3d93 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Getting quotas for project 0a7896472f034eb4b3b028d528cfbac0. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:36:31.020962 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-bf0988b8-8533-4e28-a0d9-e6a4ce0a3d93 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Getting quotas for user 54fcced6d8d943608b940d1dab001540 and project 0a7896472f034eb4b3b028d528cfbac0. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:36:31.032259 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bf0988b8-8533-4e28-a0d9-e6a4ce0a3d93 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Going to run 1 instances... {{(pid=119146) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:36:31.034920 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bf0988b8-8533-4e28-a0d9-e6a4ce0a3d93 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a874490-179e-412c-895e-52b16935c04c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119146) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:36:31.207767 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-bf0988b8-8533-4e28-a0d9-e6a4ce0a3d93 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.066765 Oct 24 13:36:31.214726 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 543/1087] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 24 13:36:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:36:31.220133 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-05604b3d-9382-49e7-94df-b1f095e1820b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:31.220773 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-05604b3d-9382-49e7-94df-b1f095e1820b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:31.315310 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-05604b3d-9382-49e7-94df-b1f095e1820b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:31.323925 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-05604b3d-9382-49e7-94df-b1f095e1820b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990" status: 200 len: 1241 microversion: 2.1 time: 0.108154 Oct 24 13:36:31.324808 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 545/1088] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:31 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:36:32.347860 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f6c5b860-4ee8-44d9-8eff-e161f36d1235 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:32.348483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f6c5b860-4ee8-44d9-8eff-e161f36d1235 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:32.400182 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f6c5b860-4ee8-44d9-8eff-e161f36d1235 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:32.406926 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f6c5b860-4ee8-44d9-8eff-e161f36d1235 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990" status: 200 len: 1241 microversion: 2.1 time: 0.063903 Oct 24 13:36:32.410521 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 544/1089] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:32 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:33.431199 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-bf12cf7e-5bf4-4296-92e3-46d9e81d2b01 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:33.431807 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-bf12cf7e-5bf4-4296-92e3-46d9e81d2b01 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:33.438578 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bf12cf7e-5bf4-4296-92e3-46d9e81d2b01 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:33.439059 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bf12cf7e-5bf4-4296-92e3-46d9e81d2b01 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:33.439491 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bf12cf7e-5bf4-4296-92e3-46d9e81d2b01 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:33.440190 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bf12cf7e-5bf4-4296-92e3-46d9e81d2b01 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:33.440666 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bf12cf7e-5bf4-4296-92e3-46d9e81d2b01 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:33.441087 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bf12cf7e-5bf4-4296-92e3-46d9e81d2b01 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:33.505743 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-bf12cf7e-5bf4-4296-92e3-46d9e81d2b01 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:33.514586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-bf12cf7e-5bf4-4296-92e3-46d9e81d2b01 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990" status: 200 len: 1293 microversion: 2.1 time: 0.087338 Oct 24 13:36:33.515152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 546/1090] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:33 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:34.539272 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-84a09e63-7e07-4f13-af4b-1f2938b4f785 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:34.540019 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-84a09e63-7e07-4f13-af4b-1f2938b4f785 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:34.549680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-84a09e63-7e07-4f13-af4b-1f2938b4f785 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:34.550211 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-84a09e63-7e07-4f13-af4b-1f2938b4f785 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:34.550666 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-84a09e63-7e07-4f13-af4b-1f2938b4f785 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:34.551355 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-84a09e63-7e07-4f13-af4b-1f2938b4f785 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:34.551818 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-84a09e63-7e07-4f13-af4b-1f2938b4f785 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:34.552218 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-84a09e63-7e07-4f13-af4b-1f2938b4f785 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:34.694869 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-84a09e63-7e07-4f13-af4b-1f2938b4f785 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:34.702931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-84a09e63-7e07-4f13-af4b-1f2938b4f785 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990" status: 200 len: 1367 microversion: 2.1 time: 0.168323 Oct 24 13:36:34.703595 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 545/1091] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:34 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:35.304224 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-1fd05b88-10c6-4711-bd96-a87c467e8f53 req-9ecb1064-583d-498a-b589-9bf4e1cf7e2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "604ec880-17e0-4294-9b1e-b57ce613c990", "tag": "1eb5ffaa-5090-4d35-8d38-63f8817fbd9e"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:36:35.313810 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-1fd05b88-10c6-4711-bd96-a87c467e8f53 req-9ecb1064-583d-498a-b589-9bf4e1cf7e2e service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:35.314278 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-1fd05b88-10c6-4711-bd96-a87c467e8f53 req-9ecb1064-583d-498a-b589-9bf4e1cf7e2e service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:35.314701 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-1fd05b88-10c6-4711-bd96-a87c467e8f53 req-9ecb1064-583d-498a-b589-9bf4e1cf7e2e service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:35.325773 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-1fd05b88-10c6-4711-bd96-a87c467e8f53 req-9ecb1064-583d-498a-b589-9bf4e1cf7e2e service nova] Creating event network-changed:1eb5ffaa-5090-4d35-8d38-63f8817fbd9e for instance 604ec880-17e0-4294-9b1e-b57ce613c990 on hv-cinder-86249 Oct 24 13:36:35.330580 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-1fd05b88-10c6-4711-bd96-a87c467e8f53 req-9ecb1064-583d-498a-b589-9bf4e1cf7e2e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090907 Oct 24 13:36:35.332077 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 547/1092] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:36:35.725981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-0e92a6f3-08a8-4f1b-a6b3-048e29c9f627 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:35.726601 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-0e92a6f3-08a8-4f1b-a6b3-048e29c9f627 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:35.733300 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0e92a6f3-08a8-4f1b-a6b3-048e29c9f627 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:35.734226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0e92a6f3-08a8-4f1b-a6b3-048e29c9f627 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:35.734226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0e92a6f3-08a8-4f1b-a6b3-048e29c9f627 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:35.734957 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0e92a6f3-08a8-4f1b-a6b3-048e29c9f627 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:35.735518 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0e92a6f3-08a8-4f1b-a6b3-048e29c9f627 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:35.735847 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0e92a6f3-08a8-4f1b-a6b3-048e29c9f627 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:35.868926 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-0e92a6f3-08a8-4f1b-a6b3-048e29c9f627 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:35.876651 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-0e92a6f3-08a8-4f1b-a6b3-048e29c9f627 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990" status: 200 len: 1367 microversion: 2.1 time: 0.154593 Oct 24 13:36:35.877217 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 546/1093] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:35 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:36.900963 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9e1209cd-c188-4aee-997e-e98866daf219 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:36.901676 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9e1209cd-c188-4aee-997e-e98866daf219 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:36.907796 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9e1209cd-c188-4aee-997e-e98866daf219 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:36.908263 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9e1209cd-c188-4aee-997e-e98866daf219 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:36.908715 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9e1209cd-c188-4aee-997e-e98866daf219 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:36.909389 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9e1209cd-c188-4aee-997e-e98866daf219 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:36.909827 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9e1209cd-c188-4aee-997e-e98866daf219 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:36.910288 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9e1209cd-c188-4aee-997e-e98866daf219 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:37.035856 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9e1209cd-c188-4aee-997e-e98866daf219 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:37.043919 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9e1209cd-c188-4aee-997e-e98866daf219 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990" status: 200 len: 1367 microversion: 2.1 time: 0.147671 Oct 24 13:36:37.044506 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 548/1094] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:36 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:38.066700 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-740aaa43-2d76-402c-861f-26801ce44acf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:38.067340 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-740aaa43-2d76-402c-861f-26801ce44acf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:38.073706 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-740aaa43-2d76-402c-861f-26801ce44acf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:38.074183 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-740aaa43-2d76-402c-861f-26801ce44acf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:38.074906 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-740aaa43-2d76-402c-861f-26801ce44acf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:38.075612 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-740aaa43-2d76-402c-861f-26801ce44acf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:38.076065 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-740aaa43-2d76-402c-861f-26801ce44acf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:38.076518 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-740aaa43-2d76-402c-861f-26801ce44acf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:38.205996 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-740aaa43-2d76-402c-861f-26801ce44acf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:38.214258 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-740aaa43-2d76-402c-861f-26801ce44acf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990" status: 200 len: 1367 microversion: 2.1 time: 0.151612 Oct 24 13:36:38.214826 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 547/1095] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:38 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:39.238716 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-0253a4be-3609-40bb-95f4-3f9c5603c2c0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:39.239349 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-0253a4be-3609-40bb-95f4-3f9c5603c2c0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:39.245808 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0253a4be-3609-40bb-95f4-3f9c5603c2c0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:39.246273 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0253a4be-3609-40bb-95f4-3f9c5603c2c0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:39.246697 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0253a4be-3609-40bb-95f4-3f9c5603c2c0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:39.247370 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0253a4be-3609-40bb-95f4-3f9c5603c2c0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:39.247808 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0253a4be-3609-40bb-95f4-3f9c5603c2c0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:39.248221 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-0253a4be-3609-40bb-95f4-3f9c5603c2c0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:39.374216 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-0253a4be-3609-40bb-95f4-3f9c5603c2c0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:39.381777 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-0253a4be-3609-40bb-95f4-3f9c5603c2c0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990" status: 200 len: 1367 microversion: 2.1 time: 0.147669 Oct 24 13:36:39.382336 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 549/1096] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:39 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:40.405118 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ec98e1cd-51e7-4e20-a575-54c8372be286 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:40.405740 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-ec98e1cd-51e7-4e20-a575-54c8372be286 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:40.412786 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ec98e1cd-51e7-4e20-a575-54c8372be286 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:40.413264 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ec98e1cd-51e7-4e20-a575-54c8372be286 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:40.413696 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ec98e1cd-51e7-4e20-a575-54c8372be286 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:40.414381 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ec98e1cd-51e7-4e20-a575-54c8372be286 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:40.414835 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ec98e1cd-51e7-4e20-a575-54c8372be286 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:40.415257 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ec98e1cd-51e7-4e20-a575-54c8372be286 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:40.545514 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-ec98e1cd-51e7-4e20-a575-54c8372be286 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:40.553341 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-ec98e1cd-51e7-4e20-a575-54c8372be286 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990" status: 200 len: 1367 microversion: 2.1 time: 0.152092 Oct 24 13:36:40.553925 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 548/1097] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:40 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:40.793194 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-f0db8140-dd19-4454-92c6-20d2ada22652 req-8b4f7064-0f06-4e1f-bf2e-69f7663f0eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "604ec880-17e0-4294-9b1e-b57ce613c990", "name": "network-vif-plugged", "status": "completed", "tag": "1eb5ffaa-5090-4d35-8d38-63f8817fbd9e"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:36:40.802704 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-f0db8140-dd19-4454-92c6-20d2ada22652 req-8b4f7064-0f06-4e1f-bf2e-69f7663f0eb2 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:40.803177 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-f0db8140-dd19-4454-92c6-20d2ada22652 req-8b4f7064-0f06-4e1f-bf2e-69f7663f0eb2 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:40.803667 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-f0db8140-dd19-4454-92c6-20d2ada22652 req-8b4f7064-0f06-4e1f-bf2e-69f7663f0eb2 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:40.814402 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-f0db8140-dd19-4454-92c6-20d2ada22652 req-8b4f7064-0f06-4e1f-bf2e-69f7663f0eb2 service nova] Creating event network-vif-plugged:1eb5ffaa-5090-4d35-8d38-63f8817fbd9e for instance 604ec880-17e0-4294-9b1e-b57ce613c990 on hv-cinder-86249 Oct 24 13:36:40.819853 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-f0db8140-dd19-4454-92c6-20d2ada22652 req-8b4f7064-0f06-4e1f-bf2e-69f7663f0eb2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083543 Oct 24 13:36:40.820639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 550/1098] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:36:41.424931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a9da3288-8903-4759-b9d1-5ab5490c0a7b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:36:41.426093 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a9da3288-8903-4759-b9d1-5ab5490c0a7b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:41.427959 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=2 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:41.433211 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a9da3288-8903-4759-b9d1-5ab5490c0a7b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:41.433688 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a9da3288-8903-4759-b9d1-5ab5490c0a7b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:41.434116 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a9da3288-8903-4759-b9d1-5ab5490c0a7b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:41.434797 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a9da3288-8903-4759-b9d1-5ab5490c0a7b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:41.435242 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a9da3288-8903-4759-b9d1-5ab5490c0a7b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:41.435656 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a9da3288-8903-4759-b9d1-5ab5490c0a7b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:41.458085 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.objects.instance [None req-a9da3288-8903-4759-b9d1-5ab5490c0a7b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lazy-loading 'flavor' on Instance uuid 25ad1362-6db1-48be-8ddb-3fa0b0f78404 {{(pid=119146) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:36:41.573409 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=6 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:41.577931 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f0abf318-cb43-46e0-a64e-d028d1ad08bd tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:41.578653 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f0abf318-cb43-46e0-a64e-d028d1ad08bd tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:41.584696 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f0abf318-cb43-46e0-a64e-d028d1ad08bd tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:41.585169 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f0abf318-cb43-46e0-a64e-d028d1ad08bd tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:41.585594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f0abf318-cb43-46e0-a64e-d028d1ad08bd tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:41.586276 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f0abf318-cb43-46e0-a64e-d028d1ad08bd tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:41.586721 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f0abf318-cb43-46e0-a64e-d028d1ad08bd tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:41.587136 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f0abf318-cb43-46e0-a64e-d028d1ad08bd tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:41.697785 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a9da3288-8903-4759-b9d1-5ab5490c0a7b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "POST /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404/action" status: 202 len: 0 microversion: 2.1 time: 0.272593 Oct 24 13:36:41.697785 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 549/1099] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 24 13:36:41 2022] POST /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:36:41.703506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e961b61c-46c1-45fe-8747-6c88175f49cc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:41.704210 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e961b61c-46c1-45fe-8747-6c88175f49cc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:41.710808 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e961b61c-46c1-45fe-8747-6c88175f49cc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:41.711306 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e961b61c-46c1-45fe-8747-6c88175f49cc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:41.711719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e961b61c-46c1-45fe-8747-6c88175f49cc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:41.712435 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e961b61c-46c1-45fe-8747-6c88175f49cc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:41.712891 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e961b61c-46c1-45fe-8747-6c88175f49cc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:41.713310 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e961b61c-46c1-45fe-8747-6c88175f49cc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:41.718067 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f0abf318-cb43-46e0-a64e-d028d1ad08bd tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:41.726424 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f0abf318-cb43-46e0-a64e-d028d1ad08bd tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990" status: 200 len: 1367 microversion: 2.1 time: 0.153956 Oct 24 13:36:41.726999 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 551/1100] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:41 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:36:41.843510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e961b61c-46c1-45fe-8747-6c88175f49cc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:41.851825 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e961b61c-46c1-45fe-8747-6c88175f49cc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1566 microversion: 2.1 time: 0.152591 Oct 24 13:36:41.852420 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 550/1101] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:41 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:42.748498 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ba36a529-fcce-4bbb-979a-580393323147 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:42.749062 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ba36a529-fcce-4bbb-979a-580393323147 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:42.756101 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba36a529-fcce-4bbb-979a-580393323147 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:42.756607 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba36a529-fcce-4bbb-979a-580393323147 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:42.757039 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba36a529-fcce-4bbb-979a-580393323147 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:42.757722 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba36a529-fcce-4bbb-979a-580393323147 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:42.758168 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba36a529-fcce-4bbb-979a-580393323147 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:42.758588 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba36a529-fcce-4bbb-979a-580393323147 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:42.874973 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c2847f31-2eec-4baf-8616-854b3b5e1211 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:42.875591 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c2847f31-2eec-4baf-8616-854b3b5e1211 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:42.877836 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=8 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:42.885818 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ba36a529-fcce-4bbb-979a-580393323147 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:42.888460 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c2847f31-2eec-4baf-8616-854b3b5e1211 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:42.889170 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c2847f31-2eec-4baf-8616-854b3b5e1211 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:42.889663 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c2847f31-2eec-4baf-8616-854b3b5e1211 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:42.890541 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c2847f31-2eec-4baf-8616-854b3b5e1211 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:42.890991 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c2847f31-2eec-4baf-8616-854b3b5e1211 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:42.891593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c2847f31-2eec-4baf-8616-854b3b5e1211 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:42.895210 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ba36a529-fcce-4bbb-979a-580393323147 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990" status: 200 len: 1557 microversion: 2.1 time: 0.150730 Oct 24 13:36:42.901307 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 552/1102] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:42 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:42.923339 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6264ec88-5ab3-42f1-9975-bce2a127ea01 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:42.923920 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-6264ec88-5ab3-42f1-9975-bce2a127ea01 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:42.930763 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6264ec88-5ab3-42f1-9975-bce2a127ea01 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:42.931249 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6264ec88-5ab3-42f1-9975-bce2a127ea01 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:42.931680 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6264ec88-5ab3-42f1-9975-bce2a127ea01 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:42.932399 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6264ec88-5ab3-42f1-9975-bce2a127ea01 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:42.933025 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6264ec88-5ab3-42f1-9975-bce2a127ea01 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:42.933446 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6264ec88-5ab3-42f1-9975-bce2a127ea01 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:43.013994 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6264ec88-5ab3-42f1-9975-bce2a127ea01 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094476 Oct 24 13:36:43.014605 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 553/1103] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 24 13:36:42 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:36:43.032197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c2847f31-2eec-4baf-8616-854b3b5e1211 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:43.040633 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c2847f31-2eec-4baf-8616-854b3b5e1211 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1566 microversion: 2.1 time: 0.169573 Oct 24 13:36:43.041203 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 551/1104] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:42 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:36:44.065167 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-040624b3-a03f-4d89-9e76-8392748c6bd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:44.065790 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-040624b3-a03f-4d89-9e76-8392748c6bd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:44.071907 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-040624b3-a03f-4d89-9e76-8392748c6bd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:44.072412 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-040624b3-a03f-4d89-9e76-8392748c6bd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:44.072842 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-040624b3-a03f-4d89-9e76-8392748c6bd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:44.073517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-040624b3-a03f-4d89-9e76-8392748c6bd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:44.073957 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-040624b3-a03f-4d89-9e76-8392748c6bd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:44.074366 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-040624b3-a03f-4d89-9e76-8392748c6bd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:44.300649 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-040624b3-a03f-4d89-9e76-8392748c6bd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:44.310813 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-040624b3-a03f-4d89-9e76-8392748c6bd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1566 microversion: 2.1 time: 0.249888 Oct 24 13:36:44.316409 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-28a97b8d-a83b-40f2-bb5a-933ae387451e req-afd09e9f-32b0-42df-9e6d-36778a327f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "604ec880-17e0-4294-9b1e-b57ce613c990", "tag": "1eb5ffaa-5090-4d35-8d38-63f8817fbd9e"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:36:44.321174 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 554/1105] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:44 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1566 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:44.328118 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-28a97b8d-a83b-40f2-bb5a-933ae387451e req-afd09e9f-32b0-42df-9e6d-36778a327f44 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:44.328715 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-28a97b8d-a83b-40f2-bb5a-933ae387451e req-afd09e9f-32b0-42df-9e6d-36778a327f44 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:44.329221 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-28a97b8d-a83b-40f2-bb5a-933ae387451e req-afd09e9f-32b0-42df-9e6d-36778a327f44 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:44.341619 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-28a97b8d-a83b-40f2-bb5a-933ae387451e req-afd09e9f-32b0-42df-9e6d-36778a327f44 service nova] Creating event network-changed:1eb5ffaa-5090-4d35-8d38-63f8817fbd9e for instance 604ec880-17e0-4294-9b1e-b57ce613c990 on hv-cinder-86249 Oct 24 13:36:44.346481 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-28a97b8d-a83b-40f2-bb5a-933ae387451e req-afd09e9f-32b0-42df-9e6d-36778a327f44 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034143 Oct 24 13:36:44.348406 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 552/1106] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:36:45.343493 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f6cd42c2-b673-4e9e-871f-51e25094bf72 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:45.344037 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f6cd42c2-b673-4e9e-871f-51e25094bf72 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:45.351007 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f6cd42c2-b673-4e9e-871f-51e25094bf72 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:45.351486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f6cd42c2-b673-4e9e-871f-51e25094bf72 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:45.351917 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f6cd42c2-b673-4e9e-871f-51e25094bf72 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:45.352630 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f6cd42c2-b673-4e9e-871f-51e25094bf72 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:45.353082 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f6cd42c2-b673-4e9e-871f-51e25094bf72 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:45.353507 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f6cd42c2-b673-4e9e-871f-51e25094bf72 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:45.488789 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f6cd42c2-b673-4e9e-871f-51e25094bf72 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:45.496420 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f6cd42c2-b673-4e9e-871f-51e25094bf72 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1566 microversion: 2.1 time: 0.156848 Oct 24 13:36:45.496989 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 555/1107] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:45 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:46.520808 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-acf237cc-e227-460b-98a8-61f846e22da2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:46.521498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-acf237cc-e227-460b-98a8-61f846e22da2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:46.527587 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-acf237cc-e227-460b-98a8-61f846e22da2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:46.528238 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-acf237cc-e227-460b-98a8-61f846e22da2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:46.528754 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-acf237cc-e227-460b-98a8-61f846e22da2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:46.529459 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-acf237cc-e227-460b-98a8-61f846e22da2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:46.529904 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-acf237cc-e227-460b-98a8-61f846e22da2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:46.530320 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-acf237cc-e227-460b-98a8-61f846e22da2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:46.658126 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-acf237cc-e227-460b-98a8-61f846e22da2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:46.666572 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-acf237cc-e227-460b-98a8-61f846e22da2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1566 microversion: 2.1 time: 0.150521 Oct 24 13:36:46.667135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 553/1108] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:46 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:47.689643 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-dd2bf713-706c-463c-8ddb-305cbb583119 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:47.690253 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-dd2bf713-706c-463c-8ddb-305cbb583119 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:47.697339 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dd2bf713-706c-463c-8ddb-305cbb583119 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:47.697813 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dd2bf713-706c-463c-8ddb-305cbb583119 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:47.698241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dd2bf713-706c-463c-8ddb-305cbb583119 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:47.698914 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dd2bf713-706c-463c-8ddb-305cbb583119 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:47.699607 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dd2bf713-706c-463c-8ddb-305cbb583119 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:47.700031 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-dd2bf713-706c-463c-8ddb-305cbb583119 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:47.827301 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-dd2bf713-706c-463c-8ddb-305cbb583119 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:47.834949 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-dd2bf713-706c-463c-8ddb-305cbb583119 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1566 microversion: 2.1 time: 0.149197 Oct 24 13:36:47.835511 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 556/1109] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:47 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:48.858567 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e2b7e9cf-514e-45df-afdf-40beb78c9f9d tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:48.859173 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e2b7e9cf-514e-45df-afdf-40beb78c9f9d tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:48.866116 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e2b7e9cf-514e-45df-afdf-40beb78c9f9d tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:48.866588 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e2b7e9cf-514e-45df-afdf-40beb78c9f9d tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:48.867012 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e2b7e9cf-514e-45df-afdf-40beb78c9f9d tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:48.867684 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e2b7e9cf-514e-45df-afdf-40beb78c9f9d tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:48.868125 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e2b7e9cf-514e-45df-afdf-40beb78c9f9d tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:48.868570 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e2b7e9cf-514e-45df-afdf-40beb78c9f9d tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:48.998865 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e2b7e9cf-514e-45df-afdf-40beb78c9f9d tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:49.006511 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e2b7e9cf-514e-45df-afdf-40beb78c9f9d tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1566 microversion: 2.1 time: 0.151760 Oct 24 13:36:49.007079 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 554/1110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:48 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:50.030074 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-4474c015-a1d5-46fb-b71d-2e49ca742923 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:50.030686 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-4474c015-a1d5-46fb-b71d-2e49ca742923 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:50.037209 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4474c015-a1d5-46fb-b71d-2e49ca742923 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:50.037685 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4474c015-a1d5-46fb-b71d-2e49ca742923 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:50.038113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4474c015-a1d5-46fb-b71d-2e49ca742923 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:50.038789 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4474c015-a1d5-46fb-b71d-2e49ca742923 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:50.039236 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4474c015-a1d5-46fb-b71d-2e49ca742923 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:50.039650 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4474c015-a1d5-46fb-b71d-2e49ca742923 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:50.170213 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-4474c015-a1d5-46fb-b71d-2e49ca742923 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:50.178438 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-4474c015-a1d5-46fb-b71d-2e49ca742923 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1566 microversion: 2.1 time: 0.152343 Oct 24 13:36:50.187412 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 557/1111] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:50 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:51.202933 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-53500846-da2d-47a8-b065-ef0bccdb104e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:51.203478 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-53500846-da2d-47a8-b065-ef0bccdb104e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:51.210744 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53500846-da2d-47a8-b065-ef0bccdb104e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:51.214142 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53500846-da2d-47a8-b065-ef0bccdb104e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:51.214142 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53500846-da2d-47a8-b065-ef0bccdb104e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:51.214142 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53500846-da2d-47a8-b065-ef0bccdb104e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:51.214142 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53500846-da2d-47a8-b065-ef0bccdb104e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:51.214531 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-53500846-da2d-47a8-b065-ef0bccdb104e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:51.341174 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-53500846-da2d-47a8-b065-ef0bccdb104e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:51.348885 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-53500846-da2d-47a8-b065-ef0bccdb104e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1566 microversion: 2.1 time: 0.150219 Oct 24 13:36:51.349451 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 555/1112] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:51 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:52.372323 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7b77658b-a059-418c-b525-aa79a4917352 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:52.372848 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-7b77658b-a059-418c-b525-aa79a4917352 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:52.378901 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7b77658b-a059-418c-b525-aa79a4917352 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:52.379368 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7b77658b-a059-418c-b525-aa79a4917352 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:52.379789 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7b77658b-a059-418c-b525-aa79a4917352 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:52.380484 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7b77658b-a059-418c-b525-aa79a4917352 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:52.380927 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7b77658b-a059-418c-b525-aa79a4917352 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:52.381337 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7b77658b-a059-418c-b525-aa79a4917352 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:52.496222 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f3a0b1cc-aa6c-4fe2-bc44-f7c51c9b3552 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:52.498449 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f3a0b1cc-aa6c-4fe2-bc44-f7c51c9b3552 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:52.505453 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f3a0b1cc-aa6c-4fe2-bc44-f7c51c9b3552 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:52.505926 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f3a0b1cc-aa6c-4fe2-bc44-f7c51c9b3552 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:52.506350 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f3a0b1cc-aa6c-4fe2-bc44-f7c51c9b3552 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:52.507032 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f3a0b1cc-aa6c-4fe2-bc44-f7c51c9b3552 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:52.507473 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f3a0b1cc-aa6c-4fe2-bc44-f7c51c9b3552 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:52.507888 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f3a0b1cc-aa6c-4fe2-bc44-f7c51c9b3552 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:52.537527 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f3a0b1cc-aa6c-4fe2-bc44-f7c51c9b3552 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045178 Oct 24 13:36:52.538089 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 556/1113] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Oct 24 13:36:52 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:36:52.592662 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-7b77658b-a059-418c-b525-aa79a4917352 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:52.601207 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-48d2bb3d-24fe-416a-b81d-a61b4f413621 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:52.601497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-7b77658b-a059-418c-b525-aa79a4917352 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1566 microversion: 2.1 time: 0.232875 Oct 24 13:36:52.601601 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-48d2bb3d-24fe-416a-b81d-a61b4f413621 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:52.602105 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 558/1114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:52 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1566 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:52.607790 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-48d2bb3d-24fe-416a-b81d-a61b4f413621 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:52.608021 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-48d2bb3d-24fe-416a-b81d-a61b4f413621 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:52.608453 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-48d2bb3d-24fe-416a-b81d-a61b4f413621 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:52.609147 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-48d2bb3d-24fe-416a-b81d-a61b4f413621 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:52.609659 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-48d2bb3d-24fe-416a-b81d-a61b4f413621 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:52.610015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-48d2bb3d-24fe-416a-b81d-a61b4f413621 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:52.635837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-48d2bb3d-24fe-416a-b81d-a61b4f413621 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Going to try to terminate instance {{(pid=119146) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:36:52.895005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-48d2bb3d-24fe-416a-b81d-a61b4f413621 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 204 len: 0 microversion: 2.20 time: 0.297352 Oct 24 13:36:52.895604 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 557/1115] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 24 13:36:52 2022] DELETE /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 24 13:36:52.904606 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-29333a20-d8c5-449f-9200-7a4f41fac70c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:52.911462 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-29333a20-d8c5-449f-9200-7a4f41fac70c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:52.911462 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-29333a20-d8c5-449f-9200-7a4f41fac70c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:52.911688 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-29333a20-d8c5-449f-9200-7a4f41fac70c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:52.912061 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-29333a20-d8c5-449f-9200-7a4f41fac70c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:52.912775 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-29333a20-d8c5-449f-9200-7a4f41fac70c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:52.913217 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-29333a20-d8c5-449f-9200-7a4f41fac70c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:52.913629 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-29333a20-d8c5-449f-9200-7a4f41fac70c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:53.056132 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-29333a20-d8c5-449f-9200-7a4f41fac70c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:53.064219 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-29333a20-d8c5-449f-9200-7a4f41fac70c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:53.065698 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-29333a20-d8c5-449f-9200-7a4f41fac70c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:53.067492 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-29333a20-d8c5-449f-9200-7a4f41fac70c tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1723 microversion: 2.20 time: 0.166727 Oct 24 13:36:53.068058 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 559/1116] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:36:52 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:36:53.625313 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-20c74df1-e08b-42e5-838c-d46e7247c3c3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:53.626005 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-20c74df1-e08b-42e5-838c-d46e7247c3c3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:53.632001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-20c74df1-e08b-42e5-838c-d46e7247c3c3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:53.632504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-20c74df1-e08b-42e5-838c-d46e7247c3c3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:53.632928 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-20c74df1-e08b-42e5-838c-d46e7247c3c3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:53.633607 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-20c74df1-e08b-42e5-838c-d46e7247c3c3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:53.634050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-20c74df1-e08b-42e5-838c-d46e7247c3c3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:53.634466 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-20c74df1-e08b-42e5-838c-d46e7247c3c3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:53.638443 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:53.767047 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-20c74df1-e08b-42e5-838c-d46e7247c3c3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:53.775386 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-20c74df1-e08b-42e5-838c-d46e7247c3c3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1566 microversion: 2.1 time: 0.154408 Oct 24 13:36:53.775954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 558/1117] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:53 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:54.093353 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-972d8277-de41-4e78-be07-3b6dfac130eb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:54.093968 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-972d8277-de41-4e78-be07-3b6dfac130eb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:54.100539 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-972d8277-de41-4e78-be07-3b6dfac130eb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:54.101013 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-972d8277-de41-4e78-be07-3b6dfac130eb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:54.101438 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-972d8277-de41-4e78-be07-3b6dfac130eb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:54.102111 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-972d8277-de41-4e78-be07-3b6dfac130eb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:54.102570 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-972d8277-de41-4e78-be07-3b6dfac130eb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:54.102968 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-972d8277-de41-4e78-be07-3b6dfac130eb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:54.228534 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-972d8277-de41-4e78-be07-3b6dfac130eb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:54.236510 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-972d8277-de41-4e78-be07-3b6dfac130eb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:54.237941 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-972d8277-de41-4e78-be07-3b6dfac130eb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:54.239089 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-972d8277-de41-4e78-be07-3b6dfac130eb tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1723 microversion: 2.20 time: 0.149609 Oct 24 13:36:54.239650 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 560/1118] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:36:54 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:36:54.799084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-2f881d69-d1ae-45db-9e84-e3a62dcbbeb3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:54.799690 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-2f881d69-d1ae-45db-9e84-e3a62dcbbeb3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:54.806691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2f881d69-d1ae-45db-9e84-e3a62dcbbeb3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:54.807163 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2f881d69-d1ae-45db-9e84-e3a62dcbbeb3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:54.807588 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2f881d69-d1ae-45db-9e84-e3a62dcbbeb3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:54.808261 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2f881d69-d1ae-45db-9e84-e3a62dcbbeb3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:54.808724 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2f881d69-d1ae-45db-9e84-e3a62dcbbeb3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:54.809135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2f881d69-d1ae-45db-9e84-e3a62dcbbeb3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:54.941857 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-2f881d69-d1ae-45db-9e84-e3a62dcbbeb3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:54.949779 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-2f881d69-d1ae-45db-9e84-e3a62dcbbeb3 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1566 microversion: 2.1 time: 0.154342 Oct 24 13:36:54.950343 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 559/1119] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:54 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:55.264388 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-10fcb9bb-42a1-429a-873b-990c42e5fb61 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:55.264915 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-10fcb9bb-42a1-429a-873b-990c42e5fb61 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:55.271715 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-10fcb9bb-42a1-429a-873b-990c42e5fb61 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:55.272178 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-10fcb9bb-42a1-429a-873b-990c42e5fb61 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:55.272624 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-10fcb9bb-42a1-429a-873b-990c42e5fb61 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:55.273292 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-10fcb9bb-42a1-429a-873b-990c42e5fb61 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:55.273733 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-10fcb9bb-42a1-429a-873b-990c42e5fb61 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:55.274144 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-10fcb9bb-42a1-429a-873b-990c42e5fb61 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:55.402417 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-10fcb9bb-42a1-429a-873b-990c42e5fb61 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:55.411170 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-10fcb9bb-42a1-429a-873b-990c42e5fb61 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:55.412976 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-10fcb9bb-42a1-429a-873b-990c42e5fb61 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:55.414167 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-10fcb9bb-42a1-429a-873b-990c42e5fb61 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1723 microversion: 2.20 time: 0.153698 Oct 24 13:36:55.414715 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 561/1120] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:36:55 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:36:55.972494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5cceb2b1-31cd-40a5-8584-3fa0ab79c314 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:55.973248 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5cceb2b1-31cd-40a5-8584-3fa0ab79c314 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:55.979679 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5cceb2b1-31cd-40a5-8584-3fa0ab79c314 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:55.980161 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5cceb2b1-31cd-40a5-8584-3fa0ab79c314 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:55.980628 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5cceb2b1-31cd-40a5-8584-3fa0ab79c314 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:55.981322 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5cceb2b1-31cd-40a5-8584-3fa0ab79c314 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:55.981771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5cceb2b1-31cd-40a5-8584-3fa0ab79c314 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:55.982193 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5cceb2b1-31cd-40a5-8584-3fa0ab79c314 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:56.115303 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5cceb2b1-31cd-40a5-8584-3fa0ab79c314 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:56.123156 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5cceb2b1-31cd-40a5-8584-3fa0ab79c314 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1566 microversion: 2.1 time: 0.154683 Oct 24 13:36:56.137497 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 560/1121] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:55 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:56.439182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-40b4492c-c109-4fff-bf0e-af24b45ee444 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:56.439782 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-40b4492c-c109-4fff-bf0e-af24b45ee444 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:56.446325 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-40b4492c-c109-4fff-bf0e-af24b45ee444 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:56.446923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-40b4492c-c109-4fff-bf0e-af24b45ee444 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:56.447350 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-40b4492c-c109-4fff-bf0e-af24b45ee444 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:56.448052 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-40b4492c-c109-4fff-bf0e-af24b45ee444 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:56.448516 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-40b4492c-c109-4fff-bf0e-af24b45ee444 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:56.448930 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-40b4492c-c109-4fff-bf0e-af24b45ee444 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:56.521996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-40b4492c-c109-4fff-bf0e-af24b45ee444 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:56.530067 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-40b4492c-c109-4fff-bf0e-af24b45ee444 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:56.531513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-40b4492c-c109-4fff-bf0e-af24b45ee444 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:56.533084 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-40b4492c-c109-4fff-bf0e-af24b45ee444 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1656 microversion: 2.20 time: 0.097470 Oct 24 13:36:56.544289 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 562/1122] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:36:56 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1656 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:36:56.685782 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-97d5058b-af22-4cb0-889b-9969cb6e5ba2 req-5f69d4eb-34a0-487e-8d50-91231bf1cbb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e111014-8ecb-4f6c-865f-a85b64d7cc69", "name": "network-vif-deleted", "tag": "13446e7b-9dfe-44f4-b0f9-5884ab770e75"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:36:56.696299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-97d5058b-af22-4cb0-889b-9969cb6e5ba2 req-5f69d4eb-34a0-487e-8d50-91231bf1cbb8 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:56.696980 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-97d5058b-af22-4cb0-889b-9969cb6e5ba2 req-5f69d4eb-34a0-487e-8d50-91231bf1cbb8 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:56.697880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-97d5058b-af22-4cb0-889b-9969cb6e5ba2 req-5f69d4eb-34a0-487e-8d50-91231bf1cbb8 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:56.710465 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-97d5058b-af22-4cb0-889b-9969cb6e5ba2 req-5f69d4eb-34a0-487e-8d50-91231bf1cbb8 service nova] Creating event network-vif-deleted:13446e7b-9dfe-44f4-b0f9-5884ab770e75 for instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 on hv-cinder-86249 Oct 24 13:36:56.716424 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-97d5058b-af22-4cb0-889b-9969cb6e5ba2 req-5f69d4eb-34a0-487e-8d50-91231bf1cbb8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034137 Oct 24 13:36:56.722091 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 561/1123] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:36:57.148090 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-4785e2d1-7ddd-4125-9133-7f1b4e1cf3e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:57.148777 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-4785e2d1-7ddd-4125-9133-7f1b4e1cf3e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:57.154754 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4785e2d1-7ddd-4125-9133-7f1b4e1cf3e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:57.155260 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4785e2d1-7ddd-4125-9133-7f1b4e1cf3e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:57.155688 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4785e2d1-7ddd-4125-9133-7f1b4e1cf3e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:57.156389 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4785e2d1-7ddd-4125-9133-7f1b4e1cf3e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:57.156843 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4785e2d1-7ddd-4125-9133-7f1b4e1cf3e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:57.157261 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4785e2d1-7ddd-4125-9133-7f1b4e1cf3e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:57.289728 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-4785e2d1-7ddd-4125-9133-7f1b4e1cf3e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:57.297730 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-4785e2d1-7ddd-4125-9133-7f1b4e1cf3e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1567 microversion: 2.1 time: 0.154075 Oct 24 13:36:57.298623 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 563/1124] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:57 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:57.323019 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e7e9dcbc-7df9-41da-9226-78c7508e37e9 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:36:57.323692 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e7e9dcbc-7df9-41da-9226-78c7508e37e9 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:57.334024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e7e9dcbc-7df9-41da-9226-78c7508e37e9 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:57.334716 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e7e9dcbc-7df9-41da-9226-78c7508e37e9 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:57.335359 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e7e9dcbc-7df9-41da-9226-78c7508e37e9 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:57.336075 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e7e9dcbc-7df9-41da-9226-78c7508e37e9 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:57.336567 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e7e9dcbc-7df9-41da-9226-78c7508e37e9 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:57.336991 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e7e9dcbc-7df9-41da-9226-78c7508e37e9 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:57.383444 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e7e9dcbc-7df9-41da-9226-78c7508e37e9 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119146) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 24 13:36:57.559020 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6dca74c8-ee46-4333-99e2-09c44225f1d8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:57.559674 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-6dca74c8-ee46-4333-99e2-09c44225f1d8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:57.570557 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6dca74c8-ee46-4333-99e2-09c44225f1d8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:57.571119 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6dca74c8-ee46-4333-99e2-09c44225f1d8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:57.571557 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6dca74c8-ee46-4333-99e2-09c44225f1d8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:57.572431 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6dca74c8-ee46-4333-99e2-09c44225f1d8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:57.572884 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6dca74c8-ee46-4333-99e2-09c44225f1d8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:57.573326 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6dca74c8-ee46-4333-99e2-09c44225f1d8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:57.580476 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=100 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:57.607722 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6dca74c8-ee46-4333-99e2-09c44225f1d8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:57.608170 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6dca74c8-ee46-4333-99e2-09c44225f1d8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:57.608640 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6dca74c8-ee46-4333-99e2-09c44225f1d8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:57.609076 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.objects.instance [None req-6dca74c8-ee46-4333-99e2-09c44225f1d8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lazy-loading 'fault' on Instance uuid 6e111014-8ecb-4f6c-865f-a85b64d7cc69 {{(pid=119145) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:36:57.656674 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-6dca74c8-ee46-4333-99e2-09c44225f1d8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:57.664988 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-6dca74c8-ee46-4333-99e2-09c44225f1d8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:57.666506 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-6dca74c8-ee46-4333-99e2-09c44225f1d8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c096064e6ec443a9e8755bc2e68dbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2196e343c45b5b741c39417ba9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:57.667669 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6dca74c8-ee46-4333-99e2-09c44225f1d8 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 200 len: 1371 microversion: 2.20 time: 0.112590 Oct 24 13:36:57.668228 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 564/1125] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:36:57 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 1371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:36:57.697954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e7e9dcbc-7df9-41da-9226-78c7508e37e9 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "POST /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404/action" status: 202 len: 0 microversion: 2.1 time: 0.379194 Oct 24 13:36:57.698492 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 562/1126] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 24 13:36:57 2022] POST /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 13:36:57.707393 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-cfed01bf-bb38-40fa-b7d0-4d3e8f4ab28a tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:57.713444 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-cfed01bf-bb38-40fa-b7d0-4d3e8f4ab28a tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:57.714339 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cfed01bf-bb38-40fa-b7d0-4d3e8f4ab28a tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:57.714630 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cfed01bf-bb38-40fa-b7d0-4d3e8f4ab28a tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:57.715057 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cfed01bf-bb38-40fa-b7d0-4d3e8f4ab28a tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:57.715745 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cfed01bf-bb38-40fa-b7d0-4d3e8f4ab28a tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:57.716192 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cfed01bf-bb38-40fa-b7d0-4d3e8f4ab28a tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:57.716648 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-cfed01bf-bb38-40fa-b7d0-4d3e8f4ab28a tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:57.882648 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-cfed01bf-bb38-40fa-b7d0-4d3e8f4ab28a tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:57.890278 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-cfed01bf-bb38-40fa-b7d0-4d3e8f4ab28a tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1515 microversion: 2.1 time: 0.187112 Oct 24 13:36:57.890852 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 565/1127] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:57 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:58.694506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-62639288-8ba6-4b66-91c8-7c6c1a35b1c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:58.695483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-62639288-8ba6-4b66-91c8-7c6c1a35b1c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:58.703608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-62639288-8ba6-4b66-91c8-7c6c1a35b1c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:58.704242 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-62639288-8ba6-4b66-91c8-7c6c1a35b1c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:58.704750 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-62639288-8ba6-4b66-91c8-7c6c1a35b1c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:58.705524 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-62639288-8ba6-4b66-91c8-7c6c1a35b1c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:58.707377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-62639288-8ba6-4b66-91c8-7c6c1a35b1c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:58.707914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-62639288-8ba6-4b66-91c8-7c6c1a35b1c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:58.721576 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-62639288-8ba6-4b66-91c8-7c6c1a35b1c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] HTTP exception thrown: Instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 could not be found. Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-62639288-8ba6-4b66-91c8-7c6c1a35b1c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Request method failure captured: Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 HTTP/1.1 Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpJIJlZfhLxtl3ybqFAHBF4hNfiQidPCZew-g-H2ZJi2ilBgsXFfUiBEKW27b8Am-r1yHzD-vve5LgLklHsX2jQdaUVAIm-ayHErSjRpeWKcNkuhZf7OmTVJNTOKZaWzaQsoAVnXS_t_jsnbodpeJ7a1I3tJ2pREXRAEg8NZcbL0BCc Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 7fa2196e343c45b5b741c39417ba9ef8 Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1521868781 Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:36:58.723555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:36:58.725388 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7fa2196e343c45b5b741c39417ba9ef8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7fa2196e343c45b5b741c39417ba9ef8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7fa2196e343c45b5b741c39417ba9ef8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7fa2196e343c45b5b741c39417ba9ef8"}]}] Oct 24 13:36:58.725388 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1521868781 Oct 24 13:36:58.725388 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 7fa2196e343c45b5b741c39417ba9ef8 Oct 24 13:36:58.725388 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1521868781 Oct 24 13:36:58.725388 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-AttachVolumeShelveTestJSON-1521868781-project Oct 24 13:36:58.725388 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:36:58.725388 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:36:58.725388 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 7c096064e6ec443a9e8755bc2e68dbb7 Oct 24 13:36:58.725388 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1521868781-project Oct 24 13:36:58.725388 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:36:58.725388 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 could not be found. Oct 24 13:36:58.725388 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': '6e111014-8ecb-4f6c-865f-a85b64d7cc69'} Oct 24 13:36:58.730501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:36:58.730501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:36:58.730501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:36:58.730501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:36:58.730501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:36:58.730501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:36:58.730501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:36:58.730501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:36:58.730501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:36:58.730501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:36:58.730501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 could not be found. Oct 24 13:36:58.730501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:36:58.730501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:36:58.730501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:36:58.730501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:36:58.730501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:36:58.730501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:36:58.730501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:36:58.730501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:36:58.730501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:36:58.732057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:36:58.732057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:36:58.732057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:36:58.732057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:36:58.732057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:36:58.732057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:36:58.732057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:36:58.732057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 could not be found. Oct 24 13:36:58.732057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:36:58.732057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:36:58.732057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:36:58.732057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:36:58.732057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:36:58.732057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:36:58.732057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:36:58.732057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:36:58.732057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 could not be found. Oct 24 13:36:58.732057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:36:58.733498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-62639288-8ba6-4b66-91c8-7c6c1a35b1c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Returning 404 to user: Instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:36:58.733498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-62639288-8ba6-4b66-91c8-7c6c1a35b1c3 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 404 len: 111 microversion: 2.20 time: 0.035725 Oct 24 13:36:58.733498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 563/1128] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:36:58 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 24 13:36:58.734490 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-81b191df-4d85-408f-8dcb-79eed8f04571 req-6187996b-cd65-4edd-b22b-5d46f6bda915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25ad1362-6db1-48be-8ddb-3fa0b0f78404", "name": "network-vif-unplugged", "status": "completed", "tag": "70dbb5cd-19fd-4c0e-b47a-955a76e67b6b"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:36:58.740340 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:58.746038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b5759288-1128-435b-959f-6a0158147904 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '.version_select at 0x7f17a83c0af0>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:58.754552 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-81b191df-4d85-408f-8dcb-79eed8f04571 req-6187996b-cd65-4edd-b22b-5d46f6bda915 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:58.755033 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-81b191df-4d85-408f-8dcb-79eed8f04571 req-6187996b-cd65-4edd-b22b-5d46f6bda915 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:58.755438 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-81b191df-4d85-408f-8dcb-79eed8f04571 req-6187996b-cd65-4edd-b22b-5d46f6bda915 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:58.767834 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.compute.server_external_events [req-81b191df-4d85-408f-8dcb-79eed8f04571 req-6187996b-cd65-4edd-b22b-5d46f6bda915 service nova] Unable to find a host for instance 25ad1362-6db1-48be-8ddb-3fa0b0f78404. Dropping event network-vif-unplugged {{(pid=119145) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 24 13:36:58.768748 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-81b191df-4d85-408f-8dcb-79eed8f04571 req-6187996b-cd65-4edd-b22b-5d46f6bda915 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038834 Oct 24 13:36:58.769975 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 566/1129] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 24 13:36:58.839006 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b5759288-1128-435b-959f-6a0158147904 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1241452208" status: 204 len: 0 microversion: 2.20 time: 0.096768 Oct 24 13:36:58.839593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 564/1130] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Oct 24 13:36:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1241452208 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 13:36:58.914250 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-817b62e9-4d24-45d2-b70b-2e64171511bc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:58.914945 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-817b62e9-4d24-45d2-b70b-2e64171511bc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:36:58.921473 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-817b62e9-4d24-45d2-b70b-2e64171511bc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:58.921944 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-817b62e9-4d24-45d2-b70b-2e64171511bc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:58.922371 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-817b62e9-4d24-45d2-b70b-2e64171511bc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:58.923052 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-817b62e9-4d24-45d2-b70b-2e64171511bc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:36:58.923578 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-817b62e9-4d24-45d2-b70b-2e64171511bc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:36:58.923991 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-817b62e9-4d24-45d2-b70b-2e64171511bc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:36:59.329954 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-817b62e9-4d24-45d2-b70b-2e64171511bc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:36:59.338089 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-817b62e9-4d24-45d2-b70b-2e64171511bc tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1517 microversion: 2.1 time: 0.428406 Oct 24 13:36:59.338760 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 567/1131] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:36:58 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1517 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:00.363046 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7dc036fb-8d4a-4906-97d3-cfccfc4abddd tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:00.363629 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7dc036fb-8d4a-4906-97d3-cfccfc4abddd tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:00.365563 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:37:00.371038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7dc036fb-8d4a-4906-97d3-cfccfc4abddd tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:00.374075 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7dc036fb-8d4a-4906-97d3-cfccfc4abddd tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:00.374075 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7dc036fb-8d4a-4906-97d3-cfccfc4abddd tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:00.374075 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7dc036fb-8d4a-4906-97d3-cfccfc4abddd tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:00.374075 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7dc036fb-8d4a-4906-97d3-cfccfc4abddd tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:00.374494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7dc036fb-8d4a-4906-97d3-cfccfc4abddd tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:00.510695 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7dc036fb-8d4a-4906-97d3-cfccfc4abddd tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:00.518573 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7dc036fb-8d4a-4906-97d3-cfccfc4abddd tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1573 microversion: 2.1 time: 0.160141 Oct 24 13:37:00.519171 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 565/1132] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:00 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:01.115926 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c0717616-3af1-4e48-8485-da71f6b018cd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:01.116456 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-c0717616-3af1-4e48-8485-da71f6b018cd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:01.123041 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c0717616-3af1-4e48-8485-da71f6b018cd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:01.123515 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c0717616-3af1-4e48-8485-da71f6b018cd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:01.123945 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c0717616-3af1-4e48-8485-da71f6b018cd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:01.124665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c0717616-3af1-4e48-8485-da71f6b018cd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:01.125118 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c0717616-3af1-4e48-8485-da71f6b018cd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:01.128951 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c0717616-3af1-4e48-8485-da71f6b018cd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:01.138803 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-c0717616-3af1-4e48-8485-da71f6b018cd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] HTTP exception thrown: Instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 could not be found. Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c0717616-3af1-4e48-8485-da71f6b018cd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Request method failure captured: Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: DELETE /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 HTTP/1.1 Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpJIJlZfhLxtl3ybqFAHBF4hNfiQidPCZew-g-H2ZJi2ilBgsXFfUiBEKW27b8Am-r1yHzD-vve5LgLklHsX2jQdaUVAIm-ayHErSjRpeWKcNkuhZf7OmTVJNTOKZaWzaQsoAVnXS_t_jsnbodpeJ7a1I3tJ2pREXRAEg8NZcbL0BCc Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: 7fa2196e343c45b5b741c39417ba9ef8 Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1521868781 Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:37:01.140547 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:37:01.142195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7fa2196e343c45b5b741c39417ba9ef8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7fa2196e343c45b5b741c39417ba9ef8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7fa2196e343c45b5b741c39417ba9ef8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7fa2196e343c45b5b741c39417ba9ef8"}]}] Oct 24 13:37:01.142195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1521868781 Oct 24 13:37:01.142195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: 7fa2196e343c45b5b741c39417ba9ef8 Oct 24 13:37:01.142195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1521868781 Oct 24 13:37:01.142195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-AttachVolumeShelveTestJSON-1521868781-project Oct 24 13:37:01.142195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:37:01.142195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:37:01.142195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 7c096064e6ec443a9e8755bc2e68dbb7 Oct 24 13:37:01.142195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1521868781-project Oct 24 13:37:01.142195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:37:01.142195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 could not be found. Oct 24 13:37:01.142195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': '6e111014-8ecb-4f6c-865f-a85b64d7cc69'} Oct 24 13:37:01.146517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:37:01.146517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:37:01.146517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:37:01.146517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:37:01.146517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:37:01.146517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:37:01.146517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:37:01.146517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:37:01.146517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:37:01.146517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:37:01.146517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 could not be found. Oct 24 13:37:01.146517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:37:01.146517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:37:01.146517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:37:01.146517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:37:01.146517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:37:01.146517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:37:01.146517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:37:01.146517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:37:01.146517 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:37:01.148107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:37:01.148107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:37:01.148107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:37:01.148107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:37:01.148107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:37:01.148107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:37:01.148107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:37:01.148107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:37:01.148107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:37:01.148107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 could not be found. Oct 24 13:37:01.148107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:37:01.148107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:37:01.148107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:37:01.148107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:37:01.148107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:37:01.148107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:37:01.148107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:37:01.148107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:37:01.148107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 could not be found. Oct 24 13:37:01.148107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:37:01.153338 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c0717616-3af1-4e48-8485-da71f6b018cd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Returning 404 to user: Instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:37:01.153338 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-c0717616-3af1-4e48-8485-da71f6b018cd tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 404 len: 111 microversion: 2.20 time: 0.030567 Oct 24 13:37:01.153338 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 568/1133] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 24 13:37:01 2022] DELETE /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:37:01.153619 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-133d5428-aa5b-408b-b639-955542723856 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:01.153619 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-133d5428-aa5b-408b-b639-955542723856 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: 6e111014-8ecb-4f6c-865f-a85b64d7cc69] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:01.158155 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-133d5428-aa5b-408b-b639-955542723856 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:01.158638 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-133d5428-aa5b-408b-b639-955542723856 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:01.159079 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-133d5428-aa5b-408b-b639-955542723856 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:01.160395 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-133d5428-aa5b-408b-b639-955542723856 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:01.160999 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-133d5428-aa5b-408b-b639-955542723856 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:01.161329 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-133d5428-aa5b-408b-b639-955542723856 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:01.174473 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-133d5428-aa5b-408b-b639-955542723856 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] HTTP exception thrown: Instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 could not be found. Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-133d5428-aa5b-408b-b639-955542723856 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Request method failure captured: Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 HTTP/1.1 Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpJIJlZfhLxtl3ybqFAHBF4hNfiQidPCZew-g-H2ZJi2ilBgsXFfUiBEKW27b8Am-r1yHzD-vve5LgLklHsX2jQdaUVAIm-ayHErSjRpeWKcNkuhZf7OmTVJNTOKZaWzaQsoAVnXS_t_jsnbodpeJ7a1I3tJ2pREXRAEg8NZcbL0BCc Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 7fa2196e343c45b5b741c39417ba9ef8 Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1521868781 Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:37:01.175994 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:37:01.177816 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7fa2196e343c45b5b741c39417ba9ef8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7fa2196e343c45b5b741c39417ba9ef8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7fa2196e343c45b5b741c39417ba9ef8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7fa2196e343c45b5b741c39417ba9ef8"}]}] Oct 24 13:37:01.177816 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1521868781 Oct 24 13:37:01.177816 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 7fa2196e343c45b5b741c39417ba9ef8 Oct 24 13:37:01.177816 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1521868781 Oct 24 13:37:01.177816 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-AttachVolumeShelveTestJSON-1521868781-project Oct 24 13:37:01.177816 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:37:01.177816 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:37:01.177816 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 7c096064e6ec443a9e8755bc2e68dbb7 Oct 24 13:37:01.177816 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1521868781-project Oct 24 13:37:01.177816 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:37:01.177816 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 could not be found. Oct 24 13:37:01.177816 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': '6e111014-8ecb-4f6c-865f-a85b64d7cc69'} Oct 24 13:37:01.185608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:37:01.185608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:37:01.185608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:37:01.185608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:37:01.185608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:37:01.185608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:37:01.185608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:37:01.185608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:37:01.185608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:37:01.185608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:37:01.185608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 could not be found. Oct 24 13:37:01.185608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:37:01.185608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:37:01.185608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:37:01.185608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:37:01.185608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:37:01.185608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:37:01.185608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:37:01.185608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:37:01.185608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:37:01.187914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:37:01.187914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:37:01.187914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:37:01.187914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:37:01.187914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:37:01.187914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:37:01.187914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:37:01.187914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 could not be found. Oct 24 13:37:01.187914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:37:01.187914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:37:01.187914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:37:01.187914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:37:01.187914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:37:01.187914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:37:01.187914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:37:01.187914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:37:01.187914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 could not be found. Oct 24 13:37:01.187914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:37:01.189659 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-133d5428-aa5b-408b-b639-955542723856 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Returning 404 to user: Instance 6e111014-8ecb-4f6c-865f-a85b64d7cc69 could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:37:01.189659 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-133d5428-aa5b-408b-b639-955542723856 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69" status: 404 len: 111 microversion: 2.20 time: 0.030410 Oct 24 13:37:01.189659 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 566/1134] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:37:01 2022] GET /compute/v2.1/servers/6e111014-8ecb-4f6c-865f-a85b64d7cc69 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:37:01.542038 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b63867cb-cf52-42c7-b95c-b146d7b6347e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:01.542605 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b63867cb-cf52-42c7-b95c-b146d7b6347e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:01.548645 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b63867cb-cf52-42c7-b95c-b146d7b6347e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:01.549122 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b63867cb-cf52-42c7-b95c-b146d7b6347e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:01.549552 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b63867cb-cf52-42c7-b95c-b146d7b6347e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:01.550230 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b63867cb-cf52-42c7-b95c-b146d7b6347e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:01.550676 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b63867cb-cf52-42c7-b95c-b146d7b6347e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:01.551090 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b63867cb-cf52-42c7-b95c-b146d7b6347e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:01.679426 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b63867cb-cf52-42c7-b95c-b146d7b6347e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:01.687148 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b63867cb-cf52-42c7-b95c-b146d7b6347e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1573 microversion: 2.1 time: 0.149067 Oct 24 13:37:01.690339 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 569/1135] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:01 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:02.433365 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-0716c0a7-49f8-41a5-9184-1ca7cf53edb6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:02.433846 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-0716c0a7-49f8-41a5-9184-1ca7cf53edb6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:02.440221 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0716c0a7-49f8-41a5-9184-1ca7cf53edb6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:02.440733 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0716c0a7-49f8-41a5-9184-1ca7cf53edb6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:02.441167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0716c0a7-49f8-41a5-9184-1ca7cf53edb6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:02.441885 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0716c0a7-49f8-41a5-9184-1ca7cf53edb6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:02.442338 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0716c0a7-49f8-41a5-9184-1ca7cf53edb6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:02.442763 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0716c0a7-49f8-41a5-9184-1ca7cf53edb6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:02.458240 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-0716c0a7-49f8-41a5-9184-1ca7cf53edb6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] HTTP exception thrown: Instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd could not be found. Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-0716c0a7-49f8-41a5-9184-1ca7cf53edb6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Request method failure captured: Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: DELETE /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd HTTP/1.1 Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpJIJlZfhLxtl3ybqFAHBF4hNfiQidPCZew-g-H2ZJi2ilBgsXFfUiBEKW27b8Am-r1yHzD-vve5LgLklHsX2jQdaUVAIm-ayHErSjRpeWKcNkuhZf7OmTVJNTOKZaWzaQsoAVnXS_t_jsnbodpeJ7a1I3tJ2pREXRAEg8NZcbL0BCc Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 7fa2196e343c45b5b741c39417ba9ef8 Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1521868781 Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:37:02.459948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:37:02.461650 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7fa2196e343c45b5b741c39417ba9ef8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7fa2196e343c45b5b741c39417ba9ef8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7fa2196e343c45b5b741c39417ba9ef8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7fa2196e343c45b5b741c39417ba9ef8"}]}] Oct 24 13:37:02.461650 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1521868781 Oct 24 13:37:02.461650 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 7fa2196e343c45b5b741c39417ba9ef8 Oct 24 13:37:02.461650 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1521868781 Oct 24 13:37:02.461650 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-AttachVolumeShelveTestJSON-1521868781-project Oct 24 13:37:02.461650 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:37:02.461650 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:37:02.461650 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 7c096064e6ec443a9e8755bc2e68dbb7 Oct 24 13:37:02.461650 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1521868781-project Oct 24 13:37:02.461650 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:37:02.461650 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd could not be found. Oct 24 13:37:02.461650 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': 'd3d04bbb-034d-4cf1-a753-9c4cb48e92bd'} Oct 24 13:37:02.465226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:37:02.465226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:37:02.465226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:37:02.465226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:37:02.465226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:37:02.465226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:37:02.465226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:37:02.465226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:37:02.465226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:37:02.465226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:37:02.465226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd could not be found. Oct 24 13:37:02.465226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:37:02.465226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:37:02.465226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:37:02.465226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:37:02.465226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:37:02.465226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:37:02.465226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:37:02.465226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:37:02.465226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:37:02.466746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:37:02.466746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:37:02.466746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:37:02.466746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:37:02.466746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:37:02.466746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:37:02.466746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:37:02.466746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:37:02.466746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:37:02.466746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd could not be found. Oct 24 13:37:02.466746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:37:02.466746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:37:02.466746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:37:02.466746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:37:02.466746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:37:02.466746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:37:02.466746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:37:02.466746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:37:02.466746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd could not be found. Oct 24 13:37:02.466746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:37:02.468335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-0716c0a7-49f8-41a5-9184-1ca7cf53edb6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Returning 404 to user: Instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:37:02.468335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-0716c0a7-49f8-41a5-9184-1ca7cf53edb6 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 404 len: 111 microversion: 2.20 time: 0.032204 Oct 24 13:37:02.468335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 567/1136] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 24 13:37:02 2022] DELETE /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:37:02.469710 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-49898a69-5fa9-4e12-9387-ec03e9269eb1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:02.470321 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-49898a69-5fa9-4e12-9387-ec03e9269eb1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] [instance: d3d04bbb-034d-4cf1-a753-9c4cb48e92bd] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:02.477324 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-49898a69-5fa9-4e12-9387-ec03e9269eb1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:02.477826 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-49898a69-5fa9-4e12-9387-ec03e9269eb1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:02.478257 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-49898a69-5fa9-4e12-9387-ec03e9269eb1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:02.478940 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-49898a69-5fa9-4e12-9387-ec03e9269eb1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:02.479387 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-49898a69-5fa9-4e12-9387-ec03e9269eb1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:02.479807 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-49898a69-5fa9-4e12-9387-ec03e9269eb1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:02.495242 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-49898a69-5fa9-4e12-9387-ec03e9269eb1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] HTTP exception thrown: Instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd could not be found. Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-49898a69-5fa9-4e12-9387-ec03e9269eb1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Request method failure captured: Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd HTTP/1.1 Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpJIJlZfhLxtl3ybqFAHBF4hNfiQidPCZew-g-H2ZJi2ilBgsXFfUiBEKW27b8Am-r1yHzD-vve5LgLklHsX2jQdaUVAIm-ayHErSjRpeWKcNkuhZf7OmTVJNTOKZaWzaQsoAVnXS_t_jsnbodpeJ7a1I3tJ2pREXRAEg8NZcbL0BCc Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: 7fa2196e343c45b5b741c39417ba9ef8 Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1521868781 Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:37:02.496768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:37:02.498514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7fa2196e343c45b5b741c39417ba9ef8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7fa2196e343c45b5b741c39417ba9ef8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7fa2196e343c45b5b741c39417ba9ef8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7fa2196e343c45b5b741c39417ba9ef8"}]}] Oct 24 13:37:02.498514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1521868781 Oct 24 13:37:02.498514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: 7fa2196e343c45b5b741c39417ba9ef8 Oct 24 13:37:02.498514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1521868781 Oct 24 13:37:02.498514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-AttachVolumeShelveTestJSON-1521868781-project Oct 24 13:37:02.498514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:37:02.498514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:37:02.498514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 7c096064e6ec443a9e8755bc2e68dbb7 Oct 24 13:37:02.498514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1521868781-project Oct 24 13:37:02.498514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:37:02.498514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd could not be found. Oct 24 13:37:02.498514 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': 'd3d04bbb-034d-4cf1-a753-9c4cb48e92bd'} Oct 24 13:37:02.499646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:37:02.499646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:37:02.499646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:37:02.499646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:37:02.499646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:37:02.499646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:37:02.499646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:37:02.499646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:37:02.499646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:37:02.499646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:37:02.499646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd could not be found. Oct 24 13:37:02.499646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:37:02.499646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:37:02.499646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:37:02.499646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:37:02.499646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:37:02.499646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:37:02.499646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:37:02.499646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:37:02.499646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:37:02.501198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:37:02.501198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:37:02.501198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:37:02.501198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:37:02.501198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:37:02.501198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:37:02.501198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:37:02.501198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd could not be found. Oct 24 13:37:02.501198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:37:02.501198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:37:02.501198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:37:02.501198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:37:02.501198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:37:02.501198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:37:02.501198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:37:02.501198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:37:02.501198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd could not be found. Oct 24 13:37:02.501198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:37:02.502728 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-49898a69-5fa9-4e12-9387-ec03e9269eb1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] Returning 404 to user: Instance d3d04bbb-034d-4cf1-a753-9c4cb48e92bd could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:37:02.502728 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-49898a69-5fa9-4e12-9387-ec03e9269eb1 tempest-AttachVolumeShelveTestJSON-1521868781 tempest-AttachVolumeShelveTestJSON-1521868781-project] 10.222.0.48 "GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd" status: 404 len: 111 microversion: 2.20 time: 0.032331 Oct 24 13:37:02.502728 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 570/1137] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 24 13:37:02 2022] GET /compute/v2.1/servers/d3d04bbb-034d-4cf1-a753-9c4cb48e92bd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 24 13:37:02.712787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-72d4f410-980c-4d18-aab6-cee209db2303 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:02.713431 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-72d4f410-980c-4d18-aab6-cee209db2303 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:02.719391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72d4f410-980c-4d18-aab6-cee209db2303 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:02.719870 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72d4f410-980c-4d18-aab6-cee209db2303 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:02.720320 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72d4f410-980c-4d18-aab6-cee209db2303 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:02.721038 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72d4f410-980c-4d18-aab6-cee209db2303 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:02.721491 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72d4f410-980c-4d18-aab6-cee209db2303 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:02.721912 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72d4f410-980c-4d18-aab6-cee209db2303 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:02.851701 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-72d4f410-980c-4d18-aab6-cee209db2303 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:02.859535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-72d4f410-980c-4d18-aab6-cee209db2303 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1573 microversion: 2.1 time: 0.150673 Oct 24 13:37:02.878939 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 568/1138] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:02 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:03.887127 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b038a4a6-87b4-4021-acb6-15ded3e3f2b7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:03.888257 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b038a4a6-87b4-4021-acb6-15ded3e3f2b7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:03.896032 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b038a4a6-87b4-4021-acb6-15ded3e3f2b7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:03.896523 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b038a4a6-87b4-4021-acb6-15ded3e3f2b7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:03.897227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b038a4a6-87b4-4021-acb6-15ded3e3f2b7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:03.898417 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b038a4a6-87b4-4021-acb6-15ded3e3f2b7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:03.898943 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b038a4a6-87b4-4021-acb6-15ded3e3f2b7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:03.899442 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b038a4a6-87b4-4021-acb6-15ded3e3f2b7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:04.134010 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b038a4a6-87b4-4021-acb6-15ded3e3f2b7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:04.141982 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b038a4a6-87b4-4021-acb6-15ded3e3f2b7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1573 microversion: 2.1 time: 0.259394 Oct 24 13:37:04.143202 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 571/1139] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:03 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1573 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:05.166482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-580ceb3f-8e5f-4dcf-829d-1c40832b1073 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:05.167078 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-580ceb3f-8e5f-4dcf-829d-1c40832b1073 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:05.174296 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-580ceb3f-8e5f-4dcf-829d-1c40832b1073 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:05.174771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-580ceb3f-8e5f-4dcf-829d-1c40832b1073 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:05.175196 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-580ceb3f-8e5f-4dcf-829d-1c40832b1073 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:05.175879 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-580ceb3f-8e5f-4dcf-829d-1c40832b1073 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:05.176357 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-580ceb3f-8e5f-4dcf-829d-1c40832b1073 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:05.176775 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-580ceb3f-8e5f-4dcf-829d-1c40832b1073 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:05.329635 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-580ceb3f-8e5f-4dcf-829d-1c40832b1073 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:05.339282 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-580ceb3f-8e5f-4dcf-829d-1c40832b1073 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1573 microversion: 2.1 time: 0.176671 Oct 24 13:37:05.341865 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 569/1140] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:05 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1573 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:06.366259 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-3d1276e3-39e7-451a-84b4-3a7c9215c343 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:06.366911 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-3d1276e3-39e7-451a-84b4-3a7c9215c343 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:06.373028 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3d1276e3-39e7-451a-84b4-3a7c9215c343 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:06.375690 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3d1276e3-39e7-451a-84b4-3a7c9215c343 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:06.375690 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3d1276e3-39e7-451a-84b4-3a7c9215c343 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:06.375690 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3d1276e3-39e7-451a-84b4-3a7c9215c343 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:06.375690 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3d1276e3-39e7-451a-84b4-3a7c9215c343 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:06.376057 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3d1276e3-39e7-451a-84b4-3a7c9215c343 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:06.508261 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-3d1276e3-39e7-451a-84b4-3a7c9215c343 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:06.516453 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-3d1276e3-39e7-451a-84b4-3a7c9215c343 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1573 microversion: 2.1 time: 0.154665 Oct 24 13:37:06.517002 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 572/1141] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:06 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:07.473477 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-aa04ced4-9cbf-4b38-a085-88caa7de4dd9 tempest-VolumesGetTestJSON-1014697141 tempest-VolumesGetTestJSON-1014697141-project] Action: 'create', calling method: .version_select at 0x7f17a3e02160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1479329297", "metadata": {"Type": "work"}}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:37:07.540568 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-5aadfd42-917d-40bb-a79e-2d285aa35704 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:07.541181 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-5aadfd42-917d-40bb-a79e-2d285aa35704 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:07.547466 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5aadfd42-917d-40bb-a79e-2d285aa35704 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:07.547945 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5aadfd42-917d-40bb-a79e-2d285aa35704 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:07.548417 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5aadfd42-917d-40bb-a79e-2d285aa35704 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:07.549301 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5aadfd42-917d-40bb-a79e-2d285aa35704 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:07.549749 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5aadfd42-917d-40bb-a79e-2d285aa35704 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:07.550175 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5aadfd42-917d-40bb-a79e-2d285aa35704 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:07.682151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-5aadfd42-917d-40bb-a79e-2d285aa35704 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:07.689907 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-5aadfd42-917d-40bb-a79e-2d285aa35704 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1573 microversion: 2.1 time: 0.153225 Oct 24 13:37:07.690472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 573/1142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:07 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:37:08.112513 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-aa04ced4-9cbf-4b38-a085-88caa7de4dd9 tempest-VolumesGetTestJSON-1014697141 tempest-VolumesGetTestJSON-1014697141-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.752910 Oct 24 13:37:08.113677 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 570/1143] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Oct 24 13:37:07 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 755 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 24 13:37:08.126522 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f50919a4-81d2-429d-9b54-3cfa08813657 tempest-VolumesGetTestJSON-1014697141 tempest-VolumesGetTestJSON-1014697141-project] Calling method '.version_select at 0x7f17a81e3ca0>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:08.178537 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f50919a4-81d2-429d-9b54-3cfa08813657 tempest-VolumesGetTestJSON-1014697141 tempest-VolumesGetTestJSON-1014697141-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/634d34a4-9b5b-486f-8ea1-5a22527ffdf4" status: 200 len: 353 microversion: 2.1 time: 0.054180 Oct 24 13:37:08.178537 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 574/1144] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 24 13:37:08 2022] GET /compute/v2.1/os-volumes/634d34a4-9b5b-486f-8ea1-5a22527ffdf4 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:37:08.714206 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-2e6d6788-0beb-4d85-89c5-fc97d31edf05 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:08.714877 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-2e6d6788-0beb-4d85-89c5-fc97d31edf05 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:08.721819 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2e6d6788-0beb-4d85-89c5-fc97d31edf05 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:08.722954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2e6d6788-0beb-4d85-89c5-fc97d31edf05 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:08.723339 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2e6d6788-0beb-4d85-89c5-fc97d31edf05 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:08.724030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2e6d6788-0beb-4d85-89c5-fc97d31edf05 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:08.724507 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2e6d6788-0beb-4d85-89c5-fc97d31edf05 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:08.724928 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2e6d6788-0beb-4d85-89c5-fc97d31edf05 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:08.853882 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-2e6d6788-0beb-4d85-89c5-fc97d31edf05 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:08.861676 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-2e6d6788-0beb-4d85-89c5-fc97d31edf05 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1573 microversion: 2.1 time: 0.151875 Oct 24 13:37:08.864336 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 571/1145] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:08 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:09.191580 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-2ab86fe3-a1ad-4455-b6af-99ee0f7c7566 tempest-VolumesGetTestJSON-1014697141 tempest-VolumesGetTestJSON-1014697141-project] Calling method '.version_select at 0x7f17a8344160>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:09.238862 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-2ab86fe3-a1ad-4455-b6af-99ee0f7c7566 tempest-VolumesGetTestJSON-1014697141 tempest-VolumesGetTestJSON-1014697141-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/634d34a4-9b5b-486f-8ea1-5a22527ffdf4" status: 200 len: 354 microversion: 2.1 time: 0.051236 Oct 24 13:37:09.239504 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 575/1146] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 24 13:37:09 2022] GET /compute/v2.1/os-volumes/634d34a4-9b5b-486f-8ea1-5a22527ffdf4 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:37:09.257989 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-34e9c4d5-6b40-4525-bf54-a76cc67d62b1 tempest-VolumesGetTestJSON-1014697141 tempest-VolumesGetTestJSON-1014697141-project] Calling method '.version_select at 0x7f17a8213940>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:09.305628 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-34e9c4d5-6b40-4525-bf54-a76cc67d62b1 tempest-VolumesGetTestJSON-1014697141 tempest-VolumesGetTestJSON-1014697141-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/634d34a4-9b5b-486f-8ea1-5a22527ffdf4" status: 200 len: 354 microversion: 2.1 time: 0.051410 Oct 24 13:37:09.306274 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 572/1147] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 24 13:37:09 2022] GET /compute/v2.1/os-volumes/634d34a4-9b5b-486f-8ea1-5a22527ffdf4 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:37:09.323985 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8d4ba57d-f9c0-4131-8859-66f42e0884d4 tempest-VolumesGetTestJSON-1014697141 tempest-VolumesGetTestJSON-1014697141-project] Calling method '.version_select at 0x7f17a81c1310>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:09.495142 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-8d4ba57d-f9c0-4131-8859-66f42e0884d4 tempest-VolumesGetTestJSON-1014697141 tempest-VolumesGetTestJSON-1014697141-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/634d34a4-9b5b-486f-8ea1-5a22527ffdf4" status: 202 len: 0 microversion: 2.1 time: 0.174851 Oct 24 13:37:09.495708 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 576/1148] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 24 13:37:09 2022] DELETE /compute/v2.1/os-volumes/634d34a4-9b5b-486f-8ea1-5a22527ffdf4 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:37:09.503977 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-cd6fbc10-c874-4374-a5ee-c999896d918e tempest-VolumesGetTestJSON-1014697141 tempest-VolumesGetTestJSON-1014697141-project] Calling method '.version_select at 0x7f17a3f681f0>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:09.551580 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-cd6fbc10-c874-4374-a5ee-c999896d918e tempest-VolumesGetTestJSON-1014697141 tempest-VolumesGetTestJSON-1014697141-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/634d34a4-9b5b-486f-8ea1-5a22527ffdf4" status: 200 len: 353 microversion: 2.1 time: 0.051526 Oct 24 13:37:09.552199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 573/1149] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 24 13:37:09 2022] GET /compute/v2.1/os-volumes/634d34a4-9b5b-486f-8ea1-5a22527ffdf4 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:37:09.885445 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ed18c3b8-f8cc-4dc3-97ee-169192e25bd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:09.885986 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ed18c3b8-f8cc-4dc3-97ee-169192e25bd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:09.891972 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ed18c3b8-f8cc-4dc3-97ee-169192e25bd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:09.892502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ed18c3b8-f8cc-4dc3-97ee-169192e25bd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:09.897584 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ed18c3b8-f8cc-4dc3-97ee-169192e25bd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:09.897584 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ed18c3b8-f8cc-4dc3-97ee-169192e25bd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:09.897584 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ed18c3b8-f8cc-4dc3-97ee-169192e25bd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:09.897584 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ed18c3b8-f8cc-4dc3-97ee-169192e25bd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:10.025976 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ed18c3b8-f8cc-4dc3-97ee-169192e25bd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:10.033844 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ed18c3b8-f8cc-4dc3-97ee-169192e25bd7 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1573 microversion: 2.1 time: 0.152306 Oct 24 13:37:10.034407 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 577/1150] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:09 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:10.567071 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8c384392-dfaa-4464-b711-a3b08758222a tempest-VolumesGetTestJSON-1014697141 tempest-VolumesGetTestJSON-1014697141-project] Calling method '.version_select at 0x7f17a3e02e50>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:10.595210 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-8c384392-dfaa-4464-b711-a3b08758222a tempest-VolumesGetTestJSON-1014697141 tempest-VolumesGetTestJSON-1014697141-project] HTTP exception thrown: Volume 634d34a4-9b5b-486f-8ea1-5a22527ffdf4 could not be found. Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8c384392-dfaa-4464-b711-a3b08758222a tempest-VolumesGetTestJSON-1014697141 tempest-VolumesGetTestJSON-1014697141-project] Request method failure captured: Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: GET /compute/v2.1/os-volumes/634d34a4-9b5b-486f-8ea1-5a22527ffdf4 HTTP/1.1 Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpUDvrMdte5hQretj92gsUhBtR55wjswv4bzTHl5F3KDLrKUXT-el52KudW4_sAdjicQHb7bPncoxxnNAmyu8vimX3L-jhfzguWR0Qxu4jId6xYY6aHLmPmjjNYPfRJ2exyK9Zzdzd2qL6NwZwtCznEtpvMEVAJFrLTKEFznXsR8FjM Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 5e4106fa08064c399dc3fb97c51aeba1 Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-VolumesGetTestJSON-1014697141 Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:37:10.597197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:37:10.598863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5e4106fa08064c399dc3fb97c51aeba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5e4106fa08064c399dc3fb97c51aeba1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5e4106fa08064c399dc3fb97c51aeba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5e4106fa08064c399dc3fb97c51aeba1"}]}] Oct 24 13:37:10.598863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-VolumesGetTestJSON-1014697141 Oct 24 13:37:10.598863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 5e4106fa08064c399dc3fb97c51aeba1 Oct 24 13:37:10.598863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-VolumesGetTestJSON-1014697141 Oct 24 13:37:10.598863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-VolumesGetTestJSON-1014697141-project Oct 24 13:37:10.598863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:37:10.598863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:37:10.598863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 8486cb52fc76461ea74161fa72d0fa3b Oct 24 13:37:10.598863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-VolumesGetTestJSON-1014697141-project Oct 24 13:37:10.598863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: Oct 24 13:37:10.598863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Volume 634d34a4-9b5b-486f-8ea1-5a22527ffdf4 could not be found. Oct 24 13:37:10.598863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': '634d34a4-9b5b-486f-8ea1-5a22527ffdf4'} Oct 24 13:37:10.598863 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:37:10.599931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:37:10.599931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:37:10.599931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:37:10.599931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:37:10.599931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:37:10.599931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:37:10.599931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:37:10.599931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:37:10.599931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:37:10.599931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:37:10.599931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:37:10.599931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:37:10.599931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:37:10.599931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:37:10.599931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:37:10.599931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 634d34a4-9b5b-486f-8ea1-5a22527ffdf4 could not be found. (HTTP 404) (Request-ID: req-26debcbd-33b9-44ec-8c17-93eea8cb2f7d) Oct 24 13:37:10.599931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:37:10.599931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:37:10.599931 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:37:10.601199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:37:10.601199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 13:37:10.601199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 13:37:10.601199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:37:10.601199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:37:10.601199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:37:10.601199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:37:10.601199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:37:10.601199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:37:10.601199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:37:10.601199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:37:10.601199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:37:10.601199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:37:10.601199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:37:10.601199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:37:10.601199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:37:10.601199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:37:10.601199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:37:10.601199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:37:10.602707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:37:10.602707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:37:10.602707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:37:10.602707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:37:10.602707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 634d34a4-9b5b-486f-8ea1-5a22527ffdf4 could not be found. Oct 24 13:37:10.602707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:37:10.602707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:37:10.602707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:37:10.602707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:37:10.602707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:37:10.602707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:37:10.602707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:37:10.602707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:37:10.602707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:37:10.602707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:37:10.602707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:37:10.602707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:37:10.602707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 13:37:10.602707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:37:10.604150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 634d34a4-9b5b-486f-8ea1-5a22527ffdf4 could not be found. Oct 24 13:37:10.604150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:37:10.604150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:37:10.604150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:37:10.604150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:37:10.604150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:37:10.604150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:37:10.604150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:37:10.604150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:37:10.604150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 634d34a4-9b5b-486f-8ea1-5a22527ffdf4 could not be found. Oct 24 13:37:10.604150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:37:10.604150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8c384392-dfaa-4464-b711-a3b08758222a tempest-VolumesGetTestJSON-1014697141 tempest-VolumesGetTestJSON-1014697141-project] Returning 404 to user: Volume 634d34a4-9b5b-486f-8ea1-5a22527ffdf4 could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:37:10.604150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8c384392-dfaa-4464-b711-a3b08758222a tempest-VolumesGetTestJSON-1014697141 tempest-VolumesGetTestJSON-1014697141-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/634d34a4-9b5b-486f-8ea1-5a22527ffdf4" status: 404 len: 109 microversion: 2.1 time: 0.036427 Oct 24 13:37:10.604150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 574/1151] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 24 13:37:10 2022] GET /compute/v2.1/os-volumes/634d34a4-9b5b-486f-8ea1-5a22527ffdf4 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:37:10.850535 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-aba148f1-1b5c-4747-b90d-f7cfa8f9510e req-d85ebf8e-2298-4590-81fd-85295032a26f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25ad1362-6db1-48be-8ddb-3fa0b0f78404", "name": "network-vif-plugged", "status": "completed", "tag": "70dbb5cd-19fd-4c0e-b47a-955a76e67b6b"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:37:10.860166 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-aba148f1-1b5c-4747-b90d-f7cfa8f9510e req-d85ebf8e-2298-4590-81fd-85295032a26f service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:10.860658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-aba148f1-1b5c-4747-b90d-f7cfa8f9510e req-d85ebf8e-2298-4590-81fd-85295032a26f service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:10.861074 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-aba148f1-1b5c-4747-b90d-f7cfa8f9510e req-d85ebf8e-2298-4590-81fd-85295032a26f service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:10.871513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-aba148f1-1b5c-4747-b90d-f7cfa8f9510e req-d85ebf8e-2298-4590-81fd-85295032a26f service nova] Creating event network-vif-plugged:70dbb5cd-19fd-4c0e-b47a-955a76e67b6b for instance 25ad1362-6db1-48be-8ddb-3fa0b0f78404 on hv-cinder-86249 Oct 24 13:37:10.876460 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-aba148f1-1b5c-4747-b90d-f7cfa8f9510e req-d85ebf8e-2298-4590-81fd-85295032a26f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029599 Oct 24 13:37:10.877032 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 578/1152] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:37:11.057505 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-895bdb30-0737-4c5f-b0c0-74eb0028b420 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:11.058121 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-895bdb30-0737-4c5f-b0c0-74eb0028b420 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:11.064386 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-895bdb30-0737-4c5f-b0c0-74eb0028b420 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:11.064983 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-895bdb30-0737-4c5f-b0c0-74eb0028b420 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:11.065418 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-895bdb30-0737-4c5f-b0c0-74eb0028b420 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:11.066676 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-895bdb30-0737-4c5f-b0c0-74eb0028b420 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:11.067129 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-895bdb30-0737-4c5f-b0c0-74eb0028b420 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:11.067552 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-895bdb30-0737-4c5f-b0c0-74eb0028b420 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:11.222898 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-895bdb30-0737-4c5f-b0c0-74eb0028b420 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:11.231009 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-895bdb30-0737-4c5f-b0c0-74eb0028b420 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1573 microversion: 2.1 time: 0.177402 Oct 24 13:37:11.231873 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 575/1153] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:11 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1573 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:12.256387 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9cde889a-aa5a-465f-8dff-9a0ca19dbd8b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:12.257163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9cde889a-aa5a-465f-8dff-9a0ca19dbd8b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:12.263303 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9cde889a-aa5a-465f-8dff-9a0ca19dbd8b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:12.263775 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9cde889a-aa5a-465f-8dff-9a0ca19dbd8b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:12.264197 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9cde889a-aa5a-465f-8dff-9a0ca19dbd8b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:12.264905 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9cde889a-aa5a-465f-8dff-9a0ca19dbd8b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:12.265343 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9cde889a-aa5a-465f-8dff-9a0ca19dbd8b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:12.265753 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9cde889a-aa5a-465f-8dff-9a0ca19dbd8b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:12.646485 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9cde889a-aa5a-465f-8dff-9a0ca19dbd8b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:12.654174 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9cde889a-aa5a-465f-8dff-9a0ca19dbd8b tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1573 microversion: 2.1 time: 0.403047 Oct 24 13:37:12.654794 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 579/1154] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:12 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1573 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:13.679042 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-6ae74397-9db3-4dce-9e15-53d17d9362a2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:13.679788 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-6ae74397-9db3-4dce-9e15-53d17d9362a2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:13.686514 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6ae74397-9db3-4dce-9e15-53d17d9362a2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:13.687088 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6ae74397-9db3-4dce-9e15-53d17d9362a2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:13.687589 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6ae74397-9db3-4dce-9e15-53d17d9362a2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:13.688373 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6ae74397-9db3-4dce-9e15-53d17d9362a2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:13.688895 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6ae74397-9db3-4dce-9e15-53d17d9362a2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:13.689382 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6ae74397-9db3-4dce-9e15-53d17d9362a2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:13.819190 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6ae74397-9db3-4dce-9e15-53d17d9362a2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:13.827212 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-6ae74397-9db3-4dce-9e15-53d17d9362a2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1560 microversion: 2.1 time: 0.151936 Oct 24 13:37:13.827719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 576/1155] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:13 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:45.336781 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-12f8bcd3-99b6-4a1b-af91-d967087bf4e2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:45.337327 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-12f8bcd3-99b6-4a1b-af91-d967087bf4e2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:45.339694 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 13:37:45.339844 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Mon Oct 24 13:37:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b (ip 10.222.0.48) !!! Oct 24 13:37:45.340836 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=21 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:37:45.341549 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=62 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:37:45.348112 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-12f8bcd3-99b6-4a1b-af91-d967087bf4e2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:45.348112 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-12f8bcd3-99b6-4a1b-af91-d967087bf4e2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:45.348552 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-12f8bcd3-99b6-4a1b-af91-d967087bf4e2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:45.349233 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-12f8bcd3-99b6-4a1b-af91-d967087bf4e2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:45.349682 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-12f8bcd3-99b6-4a1b-af91-d967087bf4e2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:45.350097 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-12f8bcd3-99b6-4a1b-af91-d967087bf4e2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:45.378294 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-12f8bcd3-99b6-4a1b-af91-d967087bf4e2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Going to try to terminate instance {{(pid=119145) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:37:45.637024 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-12f8bcd3-99b6-4a1b-af91-d967087bf4e2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 204 len: 0 microversion: 2.1 time: 0.304500 Oct 24 13:37:45.637622 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 580/1156] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:37:45 2022] DELETE /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:37:45.645901 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-af926569-6a56-4cc1-9ff8-d32e8a60291b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:45.648177 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-af926569-6a56-4cc1-9ff8-d32e8a60291b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:45.648856 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=15 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:37:45.649516 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:37:45.654263 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-af926569-6a56-4cc1-9ff8-d32e8a60291b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:45.654748 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-af926569-6a56-4cc1-9ff8-d32e8a60291b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:45.655176 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-af926569-6a56-4cc1-9ff8-d32e8a60291b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:45.655858 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-af926569-6a56-4cc1-9ff8-d32e8a60291b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:45.656335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-af926569-6a56-4cc1-9ff8-d32e8a60291b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:45.656757 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-af926569-6a56-4cc1-9ff8-d32e8a60291b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:45.792210 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-af926569-6a56-4cc1-9ff8-d32e8a60291b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:45.799704 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-af926569-6a56-4cc1-9ff8-d32e8a60291b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1572 microversion: 2.1 time: 0.157844 Oct 24 13:37:45.800331 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 577/1157] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:45 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:46.823495 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-33466069-875c-4433-94a8-c028ee072522 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:46.824449 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-33466069-875c-4433-94a8-c028ee072522 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:46.830780 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-33466069-875c-4433-94a8-c028ee072522 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:46.831253 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-33466069-875c-4433-94a8-c028ee072522 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:46.831683 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-33466069-875c-4433-94a8-c028ee072522 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:46.832387 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-33466069-875c-4433-94a8-c028ee072522 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:46.832835 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-33466069-875c-4433-94a8-c028ee072522 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:46.833254 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-33466069-875c-4433-94a8-c028ee072522 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:46.966191 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-33466069-875c-4433-94a8-c028ee072522 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:46.975271 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-33466069-875c-4433-94a8-c028ee072522 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1572 microversion: 2.1 time: 0.156062 Oct 24 13:37:46.976191 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 581/1158] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:46 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:48.004590 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7ab36631-3ac5-4328-bc9d-8be3150a8a9e tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:48.005300 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7ab36631-3ac5-4328-bc9d-8be3150a8a9e tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:48.012170 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ab36631-3ac5-4328-bc9d-8be3150a8a9e tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:48.012865 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ab36631-3ac5-4328-bc9d-8be3150a8a9e tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:48.013306 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ab36631-3ac5-4328-bc9d-8be3150a8a9e tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:48.014006 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ab36631-3ac5-4328-bc9d-8be3150a8a9e tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:48.014457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ab36631-3ac5-4328-bc9d-8be3150a8a9e tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:48.014880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7ab36631-3ac5-4328-bc9d-8be3150a8a9e tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:48.155159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7ab36631-3ac5-4328-bc9d-8be3150a8a9e tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:48.162777 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7ab36631-3ac5-4328-bc9d-8be3150a8a9e tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1572 microversion: 2.1 time: 0.162498 Oct 24 13:37:48.167609 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 578/1159] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:47 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:48.487452 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-50d9c4a5-8c1d-42a4-b1f0-042d6b78c132 req-bf5b0be6-b7ae-4245-a415-0563617ba204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5762454b-33e1-445d-a5e5-be0b4ba78d7b", "name": "network-vif-deleted", "tag": "d65e0e78-310d-4892-8600-9d032dcae474"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:37:48.497408 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-50d9c4a5-8c1d-42a4-b1f0-042d6b78c132 req-bf5b0be6-b7ae-4245-a415-0563617ba204 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:48.497871 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-50d9c4a5-8c1d-42a4-b1f0-042d6b78c132 req-bf5b0be6-b7ae-4245-a415-0563617ba204 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:48.498287 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-50d9c4a5-8c1d-42a4-b1f0-042d6b78c132 req-bf5b0be6-b7ae-4245-a415-0563617ba204 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:48.511426 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-50d9c4a5-8c1d-42a4-b1f0-042d6b78c132 req-bf5b0be6-b7ae-4245-a415-0563617ba204 service nova] Creating event network-vif-deleted:d65e0e78-310d-4892-8600-9d032dcae474 for instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b on hv-cinder-86249 Oct 24 13:37:48.514995 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-50d9c4a5-8c1d-42a4-b1f0-042d6b78c132 req-bf5b0be6-b7ae-4245-a415-0563617ba204 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031177 Oct 24 13:37:48.515592 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 582/1160] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:37:49.186982 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b208060a-006b-4968-90db-ec561dabafd5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:49.187608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b208060a-006b-4968-90db-ec561dabafd5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:49.194771 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b208060a-006b-4968-90db-ec561dabafd5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:49.195252 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b208060a-006b-4968-90db-ec561dabafd5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:49.195678 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b208060a-006b-4968-90db-ec561dabafd5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:49.196394 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b208060a-006b-4968-90db-ec561dabafd5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:49.196878 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b208060a-006b-4968-90db-ec561dabafd5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:49.197297 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b208060a-006b-4968-90db-ec561dabafd5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:49.231947 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b208060a-006b-4968-90db-ec561dabafd5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:49.232467 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b208060a-006b-4968-90db-ec561dabafd5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:49.232899 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b208060a-006b-4968-90db-ec561dabafd5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:49.233348 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.objects.instance [None req-b208060a-006b-4968-90db-ec561dabafd5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lazy-loading 'fault' on Instance uuid 5762454b-33e1-445d-a5e5-be0b4ba78d7b {{(pid=119146) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:37:49.282031 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b208060a-006b-4968-90db-ec561dabafd5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:49.291120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b208060a-006b-4968-90db-ec561dabafd5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 200 len: 1229 microversion: 2.1 time: 0.107633 Oct 24 13:37:49.291701 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 579/1161] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:49 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 1229 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:37:50.315208 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-016ca96f-0ff1-4907-9058-9761ef0d591a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:50.315821 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-016ca96f-0ff1-4907-9058-9761ef0d591a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:50.322561 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-016ca96f-0ff1-4907-9058-9761ef0d591a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:50.323053 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-016ca96f-0ff1-4907-9058-9761ef0d591a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:50.323476 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-016ca96f-0ff1-4907-9058-9761ef0d591a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:50.324476 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-016ca96f-0ff1-4907-9058-9761ef0d591a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:50.324920 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-016ca96f-0ff1-4907-9058-9761ef0d591a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:50.325336 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-016ca96f-0ff1-4907-9058-9761ef0d591a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:50.338380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-016ca96f-0ff1-4907-9058-9761ef0d591a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] HTTP exception thrown: Instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b could not be found. Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-016ca96f-0ff1-4907-9058-9761ef0d591a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Request method failure captured: Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b HTTP/1.1 Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpRbhxdELZc_i7DhRs5HUpO2Kh4fAQXjI9jJyU_R-Dsn6Pa4_WBn9qUrvbf3M8ir7YbciC6xRkl42wHqEUd0Mf-3NluUUfDljmG9smj9tmXhbdwN90uixbTLb22N61tZT9VccVcNcLOqcQFqYmYP3u5lK5kBhSxDok0TbgxsEmsFoBs Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: 46d41e46b7e3415684c32b22f31eefb5 Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-TestVolumeBootPattern-331217562 Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:37:50.340011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:37:50.341743 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_46d41e46b7e3415684c32b22f31eefb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46d41e46b7e3415684c32b22f31eefb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46d41e46b7e3415684c32b22f31eefb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/46d41e46b7e3415684c32b22f31eefb5"}]}] Oct 24 13:37:50.341743 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-TestVolumeBootPattern-331217562 Oct 24 13:37:50.341743 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: 46d41e46b7e3415684c32b22f31eefb5 Oct 24 13:37:50.341743 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-TestVolumeBootPattern-331217562 Oct 24 13:37:50.341743 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-TestVolumeBootPattern-331217562-project Oct 24 13:37:50.341743 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:37:50.341743 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:37:50.341743 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: cbdf62fbe49d44a58c294ac2c8b22ef5 Oct 24 13:37:50.341743 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-TestVolumeBootPattern-331217562-project Oct 24 13:37:50.341743 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:37:50.341743 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b could not be found. Oct 24 13:37:50.341743 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': '5762454b-33e1-445d-a5e5-be0b4ba78d7b'} Oct 24 13:37:50.342784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:37:50.342784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:37:50.342784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:37:50.342784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:37:50.342784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:37:50.342784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:37:50.342784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:37:50.342784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:37:50.342784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:37:50.342784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:37:50.342784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b could not be found. Oct 24 13:37:50.342784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:37:50.342784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:37:50.342784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:37:50.342784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:37:50.342784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:37:50.342784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:37:50.342784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:37:50.342784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:37:50.342784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:37:50.344430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:37:50.344430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:37:50.344430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:37:50.344430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:37:50.344430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:37:50.344430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:37:50.344430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:37:50.344430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b could not be found. Oct 24 13:37:50.344430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:37:50.344430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:37:50.344430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:37:50.344430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:37:50.344430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:37:50.344430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:37:50.344430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:37:50.344430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:37:50.344430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b could not be found. Oct 24 13:37:50.344430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:37:50.345851 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-016ca96f-0ff1-4907-9058-9761ef0d591a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Returning 404 to user: Instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:37:50.345851 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-016ca96f-0ff1-4907-9058-9761ef0d591a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 404 len: 111 microversion: 2.1 time: 0.030322 Oct 24 13:37:50.345851 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 583/1162] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:50 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:37:50.436849 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-55b149a4-50ae-49a1-8a36-84368423a145 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1881967161", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-827635155", "security_groups": [{"name": "tempest-secgroup-smoke-14826782"}], "block_device_mapping_v2": [{"uuid": "f117c692-17f1-4e58-90e4-cea390d389c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f594f9ca-1fdb-418d-87fd-7e11dd1c7532"}]}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:37:50.552881 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.network.neutron [None req-55b149a4-50ae-49a1-8a36-84368423a145 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] validate_networks() for [('f594f9ca-1fdb-418d-87fd-7e11dd1c7532', None, None, None, None, None)] {{(pid=119146) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:37:50.914708 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-55b149a4-50ae-49a1-8a36-84368423a145 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Flavor limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:37:50.915133 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-55b149a4-50ae-49a1-8a36-84368423a145 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Image limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:37:50.916110 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-55b149a4-50ae-49a1-8a36-84368423a145 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Flavor pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:37:50.916553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-55b149a4-50ae-49a1-8a36-84368423a145 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Image pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:37:50.916956 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-55b149a4-50ae-49a1-8a36-84368423a145 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:37:50.925580 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-55b149a4-50ae-49a1-8a36-84368423a145 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:50.926059 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-55b149a4-50ae-49a1-8a36-84368423a145 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:50.926484 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-55b149a4-50ae-49a1-8a36-84368423a145 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:50.927204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-55b149a4-50ae-49a1-8a36-84368423a145 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:50.927653 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-55b149a4-50ae-49a1-8a36-84368423a145 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:50.928075 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-55b149a4-50ae-49a1-8a36-84368423a145 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:50.944957 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-55b149a4-50ae-49a1-8a36-84368423a145 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Getting quotas for project 46d41e46b7e3415684c32b22f31eefb5. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:37:50.949625 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-55b149a4-50ae-49a1-8a36-84368423a145 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Getting quotas for user cbdf62fbe49d44a58c294ac2c8b22ef5 and project 46d41e46b7e3415684c32b22f31eefb5. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:37:51.008691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-55b149a4-50ae-49a1-8a36-84368423a145 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Going to run 1 instances... {{(pid=119146) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:37:51.011394 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-55b149a4-50ae-49a1-8a36-84368423a145 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f117c692-17f1-4e58-90e4-cea390d389c7',volume_size=None,volume_type=None)] {{(pid=119146) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:37:51.410123 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-55b149a4-50ae-49a1-8a36-84368423a145 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.977140 Oct 24 13:37:51.411050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 580/1163] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 24 13:37:50 2022] POST /compute/v2.1/servers => generated 404 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:37:51.422294 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-5542cd95-c638-4d0f-9169-ab5591fe9a69 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:51.423791 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-5542cd95-c638-4d0f-9169-ab5591fe9a69 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:51.480865 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-5542cd95-c638-4d0f-9169-ab5591fe9a69 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:51.487955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-5542cd95-c638-4d0f-9169-ab5591fe9a69 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1094 microversion: 2.1 time: 0.069580 Oct 24 13:37:51.488545 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 584/1164] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:51 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:52.578209 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-07669cf9-ad2f-4bb3-839e-b1732275483e tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:52.578209 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-07669cf9-ad2f-4bb3-839e-b1732275483e tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:52.578209 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-07669cf9-ad2f-4bb3-839e-b1732275483e tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:52.578209 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-07669cf9-ad2f-4bb3-839e-b1732275483e tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:52.579004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-07669cf9-ad2f-4bb3-839e-b1732275483e tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:52.579004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-07669cf9-ad2f-4bb3-839e-b1732275483e tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:52.579004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-07669cf9-ad2f-4bb3-839e-b1732275483e tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:52.579004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-07669cf9-ad2f-4bb3-839e-b1732275483e tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:52.589030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-07669cf9-ad2f-4bb3-839e-b1732275483e tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:52.596676 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-07669cf9-ad2f-4bb3-839e-b1732275483e tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1144 microversion: 2.1 time: 0.089192 Oct 24 13:37:52.597255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 581/1165] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:52 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:53.619332 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-37dbc43a-5d44-4c39-8e54-97b37115ed61 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:53.619948 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-37dbc43a-5d44-4c39-8e54-97b37115ed61 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:53.626684 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37dbc43a-5d44-4c39-8e54-97b37115ed61 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:53.627151 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37dbc43a-5d44-4c39-8e54-97b37115ed61 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:53.627571 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37dbc43a-5d44-4c39-8e54-97b37115ed61 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:53.628313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37dbc43a-5d44-4c39-8e54-97b37115ed61 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:53.628755 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37dbc43a-5d44-4c39-8e54-97b37115ed61 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:53.629166 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-37dbc43a-5d44-4c39-8e54-97b37115ed61 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:53.701108 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-37dbc43a-5d44-4c39-8e54-97b37115ed61 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:53.709982 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-37dbc43a-5d44-4c39-8e54-97b37115ed61 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1200 microversion: 2.1 time: 0.094774 Oct 24 13:37:53.710996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 585/1166] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:53 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1200 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:54.744608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3ff2c92b-42e6-401f-8da4-6b8836c1c077 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:54.747241 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-3ff2c92b-42e6-401f-8da4-6b8836c1c077 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:54.759751 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3ff2c92b-42e6-401f-8da4-6b8836c1c077 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:54.760306 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3ff2c92b-42e6-401f-8da4-6b8836c1c077 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:54.760936 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3ff2c92b-42e6-401f-8da4-6b8836c1c077 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:54.762628 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3ff2c92b-42e6-401f-8da4-6b8836c1c077 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:54.763465 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3ff2c92b-42e6-401f-8da4-6b8836c1c077 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:54.763907 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3ff2c92b-42e6-401f-8da4-6b8836c1c077 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:54.935448 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3ff2c92b-42e6-401f-8da4-6b8836c1c077 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:54.943435 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3ff2c92b-42e6-401f-8da4-6b8836c1c077 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1276 microversion: 2.1 time: 0.211771 Oct 24 13:37:54.944189 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 582/1167] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:54 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1276 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:55.444453 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-135d148d-0a78-453d-bda5-f98fbd599ddf req-de71fa7a-1164-435e-b456-daa95be83999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a8e9668-965e-444d-87c1-5fe36bc3b0ab", "tag": "675c4dae-b73b-4796-ba50-70bc5bd72f10"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:37:55.454755 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-135d148d-0a78-453d-bda5-f98fbd599ddf req-de71fa7a-1164-435e-b456-daa95be83999 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:55.455313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-135d148d-0a78-453d-bda5-f98fbd599ddf req-de71fa7a-1164-435e-b456-daa95be83999 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:55.455832 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-135d148d-0a78-453d-bda5-f98fbd599ddf req-de71fa7a-1164-435e-b456-daa95be83999 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:55.467170 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-135d148d-0a78-453d-bda5-f98fbd599ddf req-de71fa7a-1164-435e-b456-daa95be83999 service nova] Creating event network-changed:675c4dae-b73b-4796-ba50-70bc5bd72f10 for instance 3a8e9668-965e-444d-87c1-5fe36bc3b0ab on hv-cinder-86249 Oct 24 13:37:55.471845 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-135d148d-0a78-453d-bda5-f98fbd599ddf req-de71fa7a-1164-435e-b456-daa95be83999 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031128 Oct 24 13:37:55.472537 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 586/1168] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:37:55.967768 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-cc0794a4-3e91-4fd5-bfba-63a1351bb5f7 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:55.968519 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-cc0794a4-3e91-4fd5-bfba-63a1351bb5f7 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:55.975226 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cc0794a4-3e91-4fd5-bfba-63a1351bb5f7 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:55.975716 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cc0794a4-3e91-4fd5-bfba-63a1351bb5f7 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:55.976182 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cc0794a4-3e91-4fd5-bfba-63a1351bb5f7 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:55.976905 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cc0794a4-3e91-4fd5-bfba-63a1351bb5f7 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:55.977357 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cc0794a4-3e91-4fd5-bfba-63a1351bb5f7 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:55.977780 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cc0794a4-3e91-4fd5-bfba-63a1351bb5f7 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:56.114231 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-cc0794a4-3e91-4fd5-bfba-63a1351bb5f7 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:56.122059 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-cc0794a4-3e91-4fd5-bfba-63a1351bb5f7 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1264 microversion: 2.1 time: 0.159035 Oct 24 13:37:56.122708 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 583/1169] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:55 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:57.147315 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-51b39c8e-5679-4e83-b95e-5bab405f8fff tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:57.148005 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-51b39c8e-5679-4e83-b95e-5bab405f8fff tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:57.154838 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-51b39c8e-5679-4e83-b95e-5bab405f8fff tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:57.155306 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-51b39c8e-5679-4e83-b95e-5bab405f8fff tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:57.155742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-51b39c8e-5679-4e83-b95e-5bab405f8fff tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:57.156466 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-51b39c8e-5679-4e83-b95e-5bab405f8fff tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:57.156912 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-51b39c8e-5679-4e83-b95e-5bab405f8fff tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:57.157332 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-51b39c8e-5679-4e83-b95e-5bab405f8fff tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:57.288326 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-51b39c8e-5679-4e83-b95e-5bab405f8fff tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:57.296615 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-51b39c8e-5679-4e83-b95e-5bab405f8fff tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1264 microversion: 2.1 time: 0.153967 Oct 24 13:37:57.297197 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 587/1170] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:57 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:58.319001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-6bc165a2-4319-49e2-a252-6730915688e8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:58.319618 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-6bc165a2-4319-49e2-a252-6730915688e8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:58.326281 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6bc165a2-4319-49e2-a252-6730915688e8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:58.326762 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6bc165a2-4319-49e2-a252-6730915688e8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:58.327193 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6bc165a2-4319-49e2-a252-6730915688e8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:58.327876 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6bc165a2-4319-49e2-a252-6730915688e8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:58.328355 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6bc165a2-4319-49e2-a252-6730915688e8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:58.328780 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6bc165a2-4319-49e2-a252-6730915688e8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:58.455733 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6bc165a2-4319-49e2-a252-6730915688e8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:58.463499 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-6bc165a2-4319-49e2-a252-6730915688e8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1264 microversion: 2.1 time: 0.148434 Oct 24 13:37:58.464075 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 584/1171] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:58 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:37:59.486996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-78e3c7d8-ce75-449a-b3b7-a160e9d68bb3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:37:59.487629 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-78e3c7d8-ce75-449a-b3b7-a160e9d68bb3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:37:59.494041 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-78e3c7d8-ce75-449a-b3b7-a160e9d68bb3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:59.494511 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-78e3c7d8-ce75-449a-b3b7-a160e9d68bb3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:59.494932 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-78e3c7d8-ce75-449a-b3b7-a160e9d68bb3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:59.495604 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-78e3c7d8-ce75-449a-b3b7-a160e9d68bb3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:37:59.496044 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-78e3c7d8-ce75-449a-b3b7-a160e9d68bb3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:37:59.496489 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-78e3c7d8-ce75-449a-b3b7-a160e9d68bb3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:37:59.626249 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-78e3c7d8-ce75-449a-b3b7-a160e9d68bb3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:37:59.633841 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-78e3c7d8-ce75-449a-b3b7-a160e9d68bb3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1264 microversion: 2.1 time: 0.150787 Oct 24 13:37:59.634400 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 588/1172] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:37:59 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:00.447346 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f0397e63-2070-49f3-b6bc-aafec19f8883 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:00.447899 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f0397e63-2070-49f3-b6bc-aafec19f8883 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:00.454573 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f0397e63-2070-49f3-b6bc-aafec19f8883 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:00.455055 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f0397e63-2070-49f3-b6bc-aafec19f8883 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:00.455492 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f0397e63-2070-49f3-b6bc-aafec19f8883 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:00.456176 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f0397e63-2070-49f3-b6bc-aafec19f8883 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:00.456655 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f0397e63-2070-49f3-b6bc-aafec19f8883 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:00.457076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f0397e63-2070-49f3-b6bc-aafec19f8883 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:00.479769 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f0397e63-2070-49f3-b6bc-aafec19f8883 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990/ips" status: 200 len: 150 microversion: 2.1 time: 0.036369 Oct 24 13:38:00.480348 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 585/1173] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 24 13:38:00 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:38:00.656892 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-5fd49c77-d1ad-4a22-bab1-faac731e541f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:00.657488 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-5fd49c77-d1ad-4a22-bab1-faac731e541f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:00.663963 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5fd49c77-d1ad-4a22-bab1-faac731e541f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:00.664470 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5fd49c77-d1ad-4a22-bab1-faac731e541f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:00.664898 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5fd49c77-d1ad-4a22-bab1-faac731e541f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:00.665634 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5fd49c77-d1ad-4a22-bab1-faac731e541f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:00.666086 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5fd49c77-d1ad-4a22-bab1-faac731e541f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:00.666500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5fd49c77-d1ad-4a22-bab1-faac731e541f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:00.803727 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-5fd49c77-d1ad-4a22-bab1-faac731e541f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:00.812115 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-5fd49c77-d1ad-4a22-bab1-faac731e541f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1264 microversion: 2.1 time: 0.158996 Oct 24 13:38:00.812713 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 589/1174] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:00 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:01.835243 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-394232aa-baaf-4924-8c56-a3c1e946f39c tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:01.835795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-394232aa-baaf-4924-8c56-a3c1e946f39c tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:01.837637 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=2 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:01.838436 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=6 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:01.843728 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-394232aa-baaf-4924-8c56-a3c1e946f39c tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:01.848960 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-394232aa-baaf-4924-8c56-a3c1e946f39c tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:01.848960 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-394232aa-baaf-4924-8c56-a3c1e946f39c tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:01.848960 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-394232aa-baaf-4924-8c56-a3c1e946f39c tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:01.848960 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-394232aa-baaf-4924-8c56-a3c1e946f39c tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:01.849495 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-394232aa-baaf-4924-8c56-a3c1e946f39c tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:01.973740 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-394232aa-baaf-4924-8c56-a3c1e946f39c tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:01.981383 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-394232aa-baaf-4924-8c56-a3c1e946f39c tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1264 microversion: 2.1 time: 0.150092 Oct 24 13:38:01.981948 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 586/1175] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:01 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:38:03.004201 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-52d0bff9-92ff-4105-81d5-bb9b82967ae4 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:03.004827 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-52d0bff9-92ff-4105-81d5-bb9b82967ae4 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:03.006807 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=2 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:03.011952 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-52d0bff9-92ff-4105-81d5-bb9b82967ae4 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:03.012457 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-52d0bff9-92ff-4105-81d5-bb9b82967ae4 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:03.012880 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-52d0bff9-92ff-4105-81d5-bb9b82967ae4 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:03.013546 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-52d0bff9-92ff-4105-81d5-bb9b82967ae4 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:03.014498 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-52d0bff9-92ff-4105-81d5-bb9b82967ae4 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:03.014909 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-52d0bff9-92ff-4105-81d5-bb9b82967ae4 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:03.146334 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-52d0bff9-92ff-4105-81d5-bb9b82967ae4 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:03.153146 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f5ad3a1b-5834-46c4-8a1a-116b64076222 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65d2dfe6-01d7-4e10-86ca-75a052f862fe"}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:38:03.154482 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-52d0bff9-92ff-4105-81d5-bb9b82967ae4 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1264 microversion: 2.1 time: 0.153844 Oct 24 13:38:03.155053 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 590/1176] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:02 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:03.155709 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f5ad3a1b-5834-46c4-8a1a-116b64076222 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:03.162308 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f5ad3a1b-5834-46c4-8a1a-116b64076222 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:03.162790 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f5ad3a1b-5834-46c4-8a1a-116b64076222 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:03.163222 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f5ad3a1b-5834-46c4-8a1a-116b64076222 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:03.163917 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f5ad3a1b-5834-46c4-8a1a-116b64076222 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:03.164437 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f5ad3a1b-5834-46c4-8a1a-116b64076222 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:03.164867 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f5ad3a1b-5834-46c4-8a1a-116b64076222 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:03.858096 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f5ad3a1b-5834-46c4-8a1a-116b64076222 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "POST /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.708170 Oct 24 13:38:03.858713 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 587/1177] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 24 13:38:03 2022] POST /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990/os-volume_attachments => generated 194 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:38:04.177552 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-2b9abdd2-9df4-4fc9-9f22-29c83d6465ec tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:04.178185 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-2b9abdd2-9df4-4fc9-9f22-29c83d6465ec tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:04.184545 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2b9abdd2-9df4-4fc9-9f22-29c83d6465ec tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:04.185017 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2b9abdd2-9df4-4fc9-9f22-29c83d6465ec tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:04.185446 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2b9abdd2-9df4-4fc9-9f22-29c83d6465ec tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:04.186123 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2b9abdd2-9df4-4fc9-9f22-29c83d6465ec tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:04.186570 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2b9abdd2-9df4-4fc9-9f22-29c83d6465ec tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:04.187015 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2b9abdd2-9df4-4fc9-9f22-29c83d6465ec tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:04.313992 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-2b9abdd2-9df4-4fc9-9f22-29c83d6465ec tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:04.321990 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-2b9abdd2-9df4-4fc9-9f22-29c83d6465ec tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1264 microversion: 2.1 time: 0.148247 Oct 24 13:38:04.322568 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 591/1178] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:04 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:05.347020 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-d1505672-53b7-41e1-a520-509612df1024 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:05.347715 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-d1505672-53b7-41e1-a520-509612df1024 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:05.353877 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d1505672-53b7-41e1-a520-509612df1024 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:05.354394 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d1505672-53b7-41e1-a520-509612df1024 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:05.354821 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d1505672-53b7-41e1-a520-509612df1024 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:05.355500 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d1505672-53b7-41e1-a520-509612df1024 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:05.355946 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d1505672-53b7-41e1-a520-509612df1024 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:05.356421 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-d1505672-53b7-41e1-a520-509612df1024 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:05.490108 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-d1505672-53b7-41e1-a520-509612df1024 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:05.497724 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-d1505672-53b7-41e1-a520-509612df1024 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1264 microversion: 2.1 time: 0.155488 Oct 24 13:38:05.498288 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 588/1179] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:05 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:38:06.520573 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c3aa151a-f0db-4b43-88e9-a2b63fb6531f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:06.521176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-c3aa151a-f0db-4b43-88e9-a2b63fb6531f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:06.527652 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c3aa151a-f0db-4b43-88e9-a2b63fb6531f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:06.528131 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c3aa151a-f0db-4b43-88e9-a2b63fb6531f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:06.528572 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c3aa151a-f0db-4b43-88e9-a2b63fb6531f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:06.529243 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c3aa151a-f0db-4b43-88e9-a2b63fb6531f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:06.529684 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c3aa151a-f0db-4b43-88e9-a2b63fb6531f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:06.530097 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c3aa151a-f0db-4b43-88e9-a2b63fb6531f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:06.663846 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c3aa151a-f0db-4b43-88e9-a2b63fb6531f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:06.672050 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-c3aa151a-f0db-4b43-88e9-a2b63fb6531f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1264 microversion: 2.1 time: 0.155434 Oct 24 13:38:06.672644 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 592/1180] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:06 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:07.275738 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-1f103998-9c4c-4fa3-a9c4-d9221d937bfc req-6823329b-4fc9-49ba-8cae-267962bec7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a8e9668-965e-444d-87c1-5fe36bc3b0ab", "name": "network-vif-plugged", "status": "completed", "tag": "675c4dae-b73b-4796-ba50-70bc5bd72f10"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:38:07.286262 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-1f103998-9c4c-4fa3-a9c4-d9221d937bfc req-6823329b-4fc9-49ba-8cae-267962bec7c3 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:07.286667 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-1f103998-9c4c-4fa3-a9c4-d9221d937bfc req-6823329b-4fc9-49ba-8cae-267962bec7c3 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:07.287089 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-1f103998-9c4c-4fa3-a9c4-d9221d937bfc req-6823329b-4fc9-49ba-8cae-267962bec7c3 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:07.297613 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-1f103998-9c4c-4fa3-a9c4-d9221d937bfc req-6823329b-4fc9-49ba-8cae-267962bec7c3 service nova] Creating event network-vif-plugged:675c4dae-b73b-4796-ba50-70bc5bd72f10 for instance 3a8e9668-965e-444d-87c1-5fe36bc3b0ab on hv-cinder-86249 Oct 24 13:38:07.302991 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-1f103998-9c4c-4fa3-a9c4-d9221d937bfc req-6823329b-4fc9-49ba-8cae-267962bec7c3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030754 Oct 24 13:38:07.303280 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 589/1181] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:38:07.694967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-c674377c-7fd0-4641-a471-f46bf0e547e5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:07.695578 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-c674377c-7fd0-4641-a471-f46bf0e547e5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:07.702842 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c674377c-7fd0-4641-a471-f46bf0e547e5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:07.703316 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c674377c-7fd0-4641-a471-f46bf0e547e5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:07.703745 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c674377c-7fd0-4641-a471-f46bf0e547e5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:07.704467 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c674377c-7fd0-4641-a471-f46bf0e547e5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:07.704917 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c674377c-7fd0-4641-a471-f46bf0e547e5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:07.705333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-c674377c-7fd0-4641-a471-f46bf0e547e5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:07.836884 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-c674377c-7fd0-4641-a471-f46bf0e547e5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:07.844560 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-c674377c-7fd0-4641-a471-f46bf0e547e5 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1264 microversion: 2.1 time: 0.153490 Oct 24 13:38:07.845124 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 593/1182] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:07 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:08.867569 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f564087d-6961-4f39-bd69-703834d8e78c tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:08.868319 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f564087d-6961-4f39-bd69-703834d8e78c tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:08.874971 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f564087d-6961-4f39-bd69-703834d8e78c tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:08.875455 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f564087d-6961-4f39-bd69-703834d8e78c tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:08.875892 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f564087d-6961-4f39-bd69-703834d8e78c tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:08.876619 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f564087d-6961-4f39-bd69-703834d8e78c tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:08.877076 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f564087d-6961-4f39-bd69-703834d8e78c tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:08.877499 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f564087d-6961-4f39-bd69-703834d8e78c tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:09.006266 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f564087d-6961-4f39-bd69-703834d8e78c tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:09.015097 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f564087d-6961-4f39-bd69-703834d8e78c tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1264 microversion: 2.1 time: 0.151730 Oct 24 13:38:09.015700 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 590/1183] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:08 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:10.038353 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f18982bc-5704-4b0e-a7f7-c248c73d27e3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:10.038946 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f18982bc-5704-4b0e-a7f7-c248c73d27e3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:10.045528 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f18982bc-5704-4b0e-a7f7-c248c73d27e3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:10.046008 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f18982bc-5704-4b0e-a7f7-c248c73d27e3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:10.046441 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f18982bc-5704-4b0e-a7f7-c248c73d27e3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:10.047126 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f18982bc-5704-4b0e-a7f7-c248c73d27e3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:10.047609 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f18982bc-5704-4b0e-a7f7-c248c73d27e3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:10.048032 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f18982bc-5704-4b0e-a7f7-c248c73d27e3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:10.178467 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f18982bc-5704-4b0e-a7f7-c248c73d27e3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:10.186220 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f18982bc-5704-4b0e-a7f7-c248c73d27e3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1451 microversion: 2.1 time: 0.151736 Oct 24 13:38:10.186786 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 594/1184] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:10 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:10.208489 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3eb24d8f-96f8-4820-ab29-89e05beb7ac8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:10.209106 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-3eb24d8f-96f8-4820-ab29-89e05beb7ac8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:10.215991 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3eb24d8f-96f8-4820-ab29-89e05beb7ac8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:10.216501 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3eb24d8f-96f8-4820-ab29-89e05beb7ac8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:10.217491 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3eb24d8f-96f8-4820-ab29-89e05beb7ac8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:10.218183 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3eb24d8f-96f8-4820-ab29-89e05beb7ac8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:10.218682 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3eb24d8f-96f8-4820-ab29-89e05beb7ac8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:10.219109 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3eb24d8f-96f8-4820-ab29-89e05beb7ac8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:10.352191 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3eb24d8f-96f8-4820-ab29-89e05beb7ac8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:10.359809 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3eb24d8f-96f8-4820-ab29-89e05beb7ac8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1451 microversion: 2.1 time: 0.155164 Oct 24 13:38:10.360387 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 591/1185] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:10 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:11.395291 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-4839abd8-45fc-4ecf-8311-688bdae75041 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Action: 'create', calling method: .version_select at 0x7f17a3fd1f70>, body: {"keypair": {"name": "tempest-keypair-1396384279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqUHDblHAqdV8B9cJ34ukL6qwHxKpksVx/O/d/LjWzlVMOY8gIhFUwyUkszXYQZgBxMocrLA/9C8NlLuxpFmGAmXE4L9j6GdXj4br7VyTMWWoyCc13WAooiuzJiEmkgLg=="}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:38:11.411131 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-4839abd8-45fc-4ecf-8311-688bdae75041 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Getting quotas for project 0a7896472f034eb4b3b028d528cfbac0. Resources: {'key_pairs'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:38:11.414961 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-4839abd8-45fc-4ecf-8311-688bdae75041 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Getting quotas for user 54fcced6d8d943608b940d1dab001540 and project 0a7896472f034eb4b3b028d528cfbac0. Resources: {'key_pairs'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:38:11.506545 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-4839abd8-45fc-4ecf-8311-688bdae75041 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114971 Oct 24 13:38:11.507154 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 595/1186] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 24 13:38:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:38:12.728234 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-0c0de064-6e8c-4f25-b2a6-bbd6ff76b9ba req-f8bfede1-0919-4082-a792-ef5ca69bcfaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a8e9668-965e-444d-87c1-5fe36bc3b0ab", "tag": "675c4dae-b73b-4796-ba50-70bc5bd72f10"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:38:12.743399 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-0c0de064-6e8c-4f25-b2a6-bbd6ff76b9ba req-f8bfede1-0919-4082-a792-ef5ca69bcfaa service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:12.744842 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-0c0de064-6e8c-4f25-b2a6-bbd6ff76b9ba req-f8bfede1-0919-4082-a792-ef5ca69bcfaa service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:12.745288 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-0c0de064-6e8c-4f25-b2a6-bbd6ff76b9ba req-f8bfede1-0919-4082-a792-ef5ca69bcfaa service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:12.758203 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-0c0de064-6e8c-4f25-b2a6-bbd6ff76b9ba req-f8bfede1-0919-4082-a792-ef5ca69bcfaa service nova] Creating event network-changed:675c4dae-b73b-4796-ba50-70bc5bd72f10 for instance 3a8e9668-965e-444d-87c1-5fe36bc3b0ab on hv-cinder-86249 Oct 24 13:38:12.763484 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-0c0de064-6e8c-4f25-b2a6-bbd6ff76b9ba req-f8bfede1-0919-4082-a792-ef5ca69bcfaa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240918 Oct 24 13:38:12.764463 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 592/1187] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:38:13.806553 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-04fd2edb-497b-4cfd-98bc-a6c10094196c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-932169561", "imageRef": "1a874490-179e-412c-895e-52b16935c04c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b68375da-958f-473f-9389-64a90da42e86"}], "security_groups": [{"name": "tempest-securitygroup--1651523141"}], "key_name": "tempest-keypair-1396384279", "user_data": "}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:38:13.908983 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.network.neutron [None req-04fd2edb-497b-4cfd-98bc-a6c10094196c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] validate_networks() for [('b68375da-958f-473f-9389-64a90da42e86', None, None, None, None, None)] {{(pid=119145) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:38:14.373741 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-04fd2edb-497b-4cfd-98bc-a6c10094196c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Flavor limits 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:38:14.374193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-04fd2edb-497b-4cfd-98bc-a6c10094196c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Image limits 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:38:14.374654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-04fd2edb-497b-4cfd-98bc-a6c10094196c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Flavor pref 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:38:14.375051 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-04fd2edb-497b-4cfd-98bc-a6c10094196c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Image pref 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:38:14.375448 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-04fd2edb-497b-4cfd-98bc-a6c10094196c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:38:14.384234 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-04fd2edb-497b-4cfd-98bc-a6c10094196c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:14.384732 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-04fd2edb-497b-4cfd-98bc-a6c10094196c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:14.385156 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-04fd2edb-497b-4cfd-98bc-a6c10094196c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:14.385871 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-04fd2edb-497b-4cfd-98bc-a6c10094196c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:14.386314 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-04fd2edb-497b-4cfd-98bc-a6c10094196c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:14.386725 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-04fd2edb-497b-4cfd-98bc-a6c10094196c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:14.403112 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-04fd2edb-497b-4cfd-98bc-a6c10094196c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Getting quotas for project 0a7896472f034eb4b3b028d528cfbac0. Resources: {'ram', 'instances', 'cores'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:38:14.407541 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-04fd2edb-497b-4cfd-98bc-a6c10094196c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Getting quotas for user 54fcced6d8d943608b940d1dab001540 and project 0a7896472f034eb4b3b028d528cfbac0. Resources: {'ram', 'instances', 'cores'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:38:14.418557 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-04fd2edb-497b-4cfd-98bc-a6c10094196c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Going to run 1 instances... {{(pid=119145) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:38:14.421330 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-04fd2edb-497b-4cfd-98bc-a6c10094196c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a874490-179e-412c-895e-52b16935c04c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119145) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:38:14.559749 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-04fd2edb-497b-4cfd-98bc-a6c10094196c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.757921 Oct 24 13:38:14.560633 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 596/1188] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 24 13:38:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:38:14.572516 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-29a3953b-c761-4f39-9ead-974578b358c0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:14.574146 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-29a3953b-c761-4f39-9ead-974578b358c0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:14.629183 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-29a3953b-c761-4f39-9ead-974578b358c0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:14.637734 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-29a3953b-c761-4f39-9ead-974578b358c0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 200 len: 1241 microversion: 2.1 time: 0.069516 Oct 24 13:38:14.638309 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 593/1189] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:14 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:15.660786 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ea02cc7a-dc5f-4db3-8154-107c1c84f12e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:15.661392 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ea02cc7a-dc5f-4db3-8154-107c1c84f12e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:15.664110 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:15.668877 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ea02cc7a-dc5f-4db3-8154-107c1c84f12e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:15.669346 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ea02cc7a-dc5f-4db3-8154-107c1c84f12e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:15.669769 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ea02cc7a-dc5f-4db3-8154-107c1c84f12e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:15.670441 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ea02cc7a-dc5f-4db3-8154-107c1c84f12e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:15.670880 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ea02cc7a-dc5f-4db3-8154-107c1c84f12e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:15.671286 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ea02cc7a-dc5f-4db3-8154-107c1c84f12e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:15.675163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:15.732619 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ea02cc7a-dc5f-4db3-8154-107c1c84f12e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:15.740079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ea02cc7a-dc5f-4db3-8154-107c1c84f12e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 200 len: 1245 microversion: 2.1 time: 0.083756 Oct 24 13:38:15.740799 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 597/1190] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:15 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:16.763086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-85bf1394-b531-4692-8577-87e03100e5f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:16.763708 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-85bf1394-b531-4692-8577-87e03100e5f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:16.767199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:16.773068 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-85bf1394-b531-4692-8577-87e03100e5f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:16.773640 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-85bf1394-b531-4692-8577-87e03100e5f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:16.774313 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-85bf1394-b531-4692-8577-87e03100e5f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:16.775126 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-85bf1394-b531-4692-8577-87e03100e5f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:16.775782 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-85bf1394-b531-4692-8577-87e03100e5f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:16.776542 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-85bf1394-b531-4692-8577-87e03100e5f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:16.840307 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-85bf1394-b531-4692-8577-87e03100e5f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:16.848636 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-85bf1394-b531-4692-8577-87e03100e5f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 200 len: 1311 microversion: 2.1 time: 0.089509 Oct 24 13:38:16.856793 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 594/1191] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:16 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 1311 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:17.872306 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a4c93ca6-4f07-4af1-bf0b-e6d7b4d007d4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:17.872888 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a4c93ca6-4f07-4af1-bf0b-e6d7b4d007d4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:17.880000 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a4c93ca6-4f07-4af1-bf0b-e6d7b4d007d4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:17.880500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a4c93ca6-4f07-4af1-bf0b-e6d7b4d007d4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:17.880925 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a4c93ca6-4f07-4af1-bf0b-e6d7b4d007d4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:17.881595 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a4c93ca6-4f07-4af1-bf0b-e6d7b4d007d4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:17.882034 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a4c93ca6-4f07-4af1-bf0b-e6d7b4d007d4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:17.882445 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a4c93ca6-4f07-4af1-bf0b-e6d7b4d007d4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:18.098550 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a4c93ca6-4f07-4af1-bf0b-e6d7b4d007d4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:18.106176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a4c93ca6-4f07-4af1-bf0b-e6d7b4d007d4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 200 len: 1367 microversion: 2.1 time: 0.238527 Oct 24 13:38:18.106742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 598/1192] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:17 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:18.356970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-dd5e74bd-a6d6-4c91-b5af-93ef6a1fb64b req-2c20cf79-1848-43c5-97b3-c98fd4d7d81e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d5d796-9064-416a-9947-0f27ff79e5c0", "tag": "fe775a60-888c-437e-ab0f-adbec1202b69"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:38:18.368182 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-dd5e74bd-a6d6-4c91-b5af-93ef6a1fb64b req-2c20cf79-1848-43c5-97b3-c98fd4d7d81e service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:18.368696 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-dd5e74bd-a6d6-4c91-b5af-93ef6a1fb64b req-2c20cf79-1848-43c5-97b3-c98fd4d7d81e service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:18.369119 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-dd5e74bd-a6d6-4c91-b5af-93ef6a1fb64b req-2c20cf79-1848-43c5-97b3-c98fd4d7d81e service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:18.372898 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:18.382865 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-dd5e74bd-a6d6-4c91-b5af-93ef6a1fb64b req-2c20cf79-1848-43c5-97b3-c98fd4d7d81e service nova] Creating event network-changed:fe775a60-888c-437e-ab0f-adbec1202b69 for instance 69d5d796-9064-416a-9947-0f27ff79e5c0 on hv-cinder-86249 Oct 24 13:38:18.388426 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-dd5e74bd-a6d6-4c91-b5af-93ef6a1fb64b req-2c20cf79-1848-43c5-97b3-c98fd4d7d81e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035898 Oct 24 13:38:18.388971 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 595/1193] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:38:19.130335 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-4d750c8e-b594-453b-a85e-c5542109a168 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:19.130937 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-4d750c8e-b594-453b-a85e-c5542109a168 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:19.137166 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4d750c8e-b594-453b-a85e-c5542109a168 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:19.137709 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4d750c8e-b594-453b-a85e-c5542109a168 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:19.138133 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4d750c8e-b594-453b-a85e-c5542109a168 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:19.138801 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4d750c8e-b594-453b-a85e-c5542109a168 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:19.139241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4d750c8e-b594-453b-a85e-c5542109a168 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:19.139681 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4d750c8e-b594-453b-a85e-c5542109a168 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:19.270657 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-4d750c8e-b594-453b-a85e-c5542109a168 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:19.278262 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-4d750c8e-b594-453b-a85e-c5542109a168 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 200 len: 1367 microversion: 2.1 time: 0.151799 Oct 24 13:38:19.278825 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 599/1194] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:19 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:20.302366 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7bbb80b7-e577-424f-97cb-a488f863e44a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:20.303054 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7bbb80b7-e577-424f-97cb-a488f863e44a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:20.310142 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7bbb80b7-e577-424f-97cb-a488f863e44a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:20.310611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7bbb80b7-e577-424f-97cb-a488f863e44a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:20.311035 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7bbb80b7-e577-424f-97cb-a488f863e44a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:20.312215 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7bbb80b7-e577-424f-97cb-a488f863e44a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:20.312686 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7bbb80b7-e577-424f-97cb-a488f863e44a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:20.313096 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7bbb80b7-e577-424f-97cb-a488f863e44a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:20.439165 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7bbb80b7-e577-424f-97cb-a488f863e44a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:20.446686 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7bbb80b7-e577-424f-97cb-a488f863e44a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 200 len: 1367 microversion: 2.1 time: 0.149139 Oct 24 13:38:20.447248 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 596/1195] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:20 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:38:21.469390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f0f00ab5-8760-4a2e-b6b2-384c4ffc4e95 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:21.470007 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f0f00ab5-8760-4a2e-b6b2-384c4ffc4e95 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:21.476487 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f0f00ab5-8760-4a2e-b6b2-384c4ffc4e95 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:21.476961 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f0f00ab5-8760-4a2e-b6b2-384c4ffc4e95 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:21.477388 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f0f00ab5-8760-4a2e-b6b2-384c4ffc4e95 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:21.478061 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f0f00ab5-8760-4a2e-b6b2-384c4ffc4e95 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:21.478506 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f0f00ab5-8760-4a2e-b6b2-384c4ffc4e95 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:21.478919 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f0f00ab5-8760-4a2e-b6b2-384c4ffc4e95 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:21.604235 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f0f00ab5-8760-4a2e-b6b2-384c4ffc4e95 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:21.611838 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f0f00ab5-8760-4a2e-b6b2-384c4ffc4e95 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 200 len: 1367 microversion: 2.1 time: 0.147089 Oct 24 13:38:21.612424 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 600/1196] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:21 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:22.635006 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-88ecf2da-6c90-4165-840e-aa08cf56f307 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:22.635654 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-88ecf2da-6c90-4165-840e-aa08cf56f307 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:22.642652 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-88ecf2da-6c90-4165-840e-aa08cf56f307 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:22.643130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-88ecf2da-6c90-4165-840e-aa08cf56f307 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:22.643569 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-88ecf2da-6c90-4165-840e-aa08cf56f307 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:22.644256 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-88ecf2da-6c90-4165-840e-aa08cf56f307 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:22.644728 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-88ecf2da-6c90-4165-840e-aa08cf56f307 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:22.645148 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-88ecf2da-6c90-4165-840e-aa08cf56f307 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:22.773790 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-88ecf2da-6c90-4165-840e-aa08cf56f307 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:22.782024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-88ecf2da-6c90-4165-840e-aa08cf56f307 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 200 len: 1367 microversion: 2.1 time: 0.150930 Oct 24 13:38:22.782597 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 597/1197] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:22 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:23.803536 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ef2412f5-1a35-4742-a67d-6a723a2e721f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:23.805267 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ef2412f5-1a35-4742-a67d-6a723a2e721f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:23.810973 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ef2412f5-1a35-4742-a67d-6a723a2e721f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:23.811459 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ef2412f5-1a35-4742-a67d-6a723a2e721f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:23.811890 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ef2412f5-1a35-4742-a67d-6a723a2e721f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:23.812605 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ef2412f5-1a35-4742-a67d-6a723a2e721f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:23.813055 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ef2412f5-1a35-4742-a67d-6a723a2e721f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:23.813480 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ef2412f5-1a35-4742-a67d-6a723a2e721f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:23.948337 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ef2412f5-1a35-4742-a67d-6a723a2e721f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:23.956172 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ef2412f5-1a35-4742-a67d-6a723a2e721f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 200 len: 1367 microversion: 2.1 time: 0.156524 Oct 24 13:38:23.956767 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 601/1198] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:23 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:24.979473 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e4f173c7-56a6-4df2-95e0-6380e6589569 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:24.980094 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e4f173c7-56a6-4df2-95e0-6380e6589569 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:24.982519 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=2 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:24.989399 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e4f173c7-56a6-4df2-95e0-6380e6589569 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:24.989880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e4f173c7-56a6-4df2-95e0-6380e6589569 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:24.990314 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e4f173c7-56a6-4df2-95e0-6380e6589569 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:24.991003 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e4f173c7-56a6-4df2-95e0-6380e6589569 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:24.991454 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e4f173c7-56a6-4df2-95e0-6380e6589569 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:24.991877 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e4f173c7-56a6-4df2-95e0-6380e6589569 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:25.125781 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e4f173c7-56a6-4df2-95e0-6380e6589569 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:25.134482 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e4f173c7-56a6-4df2-95e0-6380e6589569 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 200 len: 1367 microversion: 2.1 time: 0.158834 Oct 24 13:38:25.135138 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 598/1199] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:24 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:25.345529 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-a0a76dda-7aad-4c2b-8774-3ecf550fae38 req-30fd202b-227c-45f5-99ca-bc8c4d7c7c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d5d796-9064-416a-9947-0f27ff79e5c0", "name": "network-vif-plugged", "status": "completed", "tag": "fe775a60-888c-437e-ab0f-adbec1202b69"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:38:25.350533 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=2 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:25.351208 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=10 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:25.357019 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-a0a76dda-7aad-4c2b-8774-3ecf550fae38 req-30fd202b-227c-45f5-99ca-bc8c4d7c7c53 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:25.360466 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-a0a76dda-7aad-4c2b-8774-3ecf550fae38 req-30fd202b-227c-45f5-99ca-bc8c4d7c7c53 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:25.360466 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-a0a76dda-7aad-4c2b-8774-3ecf550fae38 req-30fd202b-227c-45f5-99ca-bc8c4d7c7c53 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:25.369359 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-a0a76dda-7aad-4c2b-8774-3ecf550fae38 req-30fd202b-227c-45f5-99ca-bc8c4d7c7c53 service nova] Creating event network-vif-plugged:fe775a60-888c-437e-ab0f-adbec1202b69 for instance 69d5d796-9064-416a-9947-0f27ff79e5c0 on hv-cinder-86249 Oct 24 13:38:25.374446 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-a0a76dda-7aad-4c2b-8774-3ecf550fae38 req-30fd202b-227c-45f5-99ca-bc8c4d7c7c53 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033406 Oct 24 13:38:25.375098 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 602/1200] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:38:26.156928 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b80d4f51-093d-4249-bdbd-3c7b6a948c00 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:26.157533 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b80d4f51-093d-4249-bdbd-3c7b6a948c00 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:26.163850 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b80d4f51-093d-4249-bdbd-3c7b6a948c00 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:26.164354 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b80d4f51-093d-4249-bdbd-3c7b6a948c00 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:26.164783 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b80d4f51-093d-4249-bdbd-3c7b6a948c00 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:26.165577 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b80d4f51-093d-4249-bdbd-3c7b6a948c00 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:26.166019 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b80d4f51-093d-4249-bdbd-3c7b6a948c00 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:26.166439 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b80d4f51-093d-4249-bdbd-3c7b6a948c00 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:26.294296 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b80d4f51-093d-4249-bdbd-3c7b6a948c00 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:26.301805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b80d4f51-093d-4249-bdbd-3c7b6a948c00 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 200 len: 1367 microversion: 2.1 time: 0.148973 Oct 24 13:38:26.302364 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 599/1201] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:26 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:27.326844 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8ffea6f6-0480-4c0b-a637-898dd0cd5a81 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:27.327574 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-8ffea6f6-0480-4c0b-a637-898dd0cd5a81 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:27.334115 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8ffea6f6-0480-4c0b-a637-898dd0cd5a81 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:27.334584 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8ffea6f6-0480-4c0b-a637-898dd0cd5a81 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:27.335012 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8ffea6f6-0480-4c0b-a637-898dd0cd5a81 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:27.335749 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8ffea6f6-0480-4c0b-a637-898dd0cd5a81 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:27.336195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8ffea6f6-0480-4c0b-a637-898dd0cd5a81 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:27.336647 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8ffea6f6-0480-4c0b-a637-898dd0cd5a81 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:27.471959 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-8ffea6f6-0480-4c0b-a637-898dd0cd5a81 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:27.479595 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-8ffea6f6-0480-4c0b-a637-898dd0cd5a81 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 200 len: 1367 microversion: 2.1 time: 0.158332 Oct 24 13:38:27.480158 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 603/1202] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:27 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:28.503681 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9e6854a7-ad8b-4c4a-af18-3eefeeb906fa tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:28.504357 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-9e6854a7-ad8b-4c4a-af18-3eefeeb906fa tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:28.510884 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9e6854a7-ad8b-4c4a-af18-3eefeeb906fa tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:28.511365 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9e6854a7-ad8b-4c4a-af18-3eefeeb906fa tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:28.511795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9e6854a7-ad8b-4c4a-af18-3eefeeb906fa tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:28.512515 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9e6854a7-ad8b-4c4a-af18-3eefeeb906fa tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:28.512968 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9e6854a7-ad8b-4c4a-af18-3eefeeb906fa tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:28.513389 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9e6854a7-ad8b-4c4a-af18-3eefeeb906fa tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:28.640450 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-9e6854a7-ad8b-4c4a-af18-3eefeeb906fa tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:28.648138 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9e6854a7-ad8b-4c4a-af18-3eefeeb906fa tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 200 len: 1556 microversion: 2.1 time: 0.148877 Oct 24 13:38:28.648919 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 600/1203] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:28 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:28.672728 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-76634aae-258b-4a23-a867-9030b82488b1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:28.673243 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-76634aae-258b-4a23-a867-9030b82488b1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:28.679549 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76634aae-258b-4a23-a867-9030b82488b1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:28.680012 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76634aae-258b-4a23-a867-9030b82488b1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:28.680494 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76634aae-258b-4a23-a867-9030b82488b1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:28.681167 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76634aae-258b-4a23-a867-9030b82488b1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:28.681614 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76634aae-258b-4a23-a867-9030b82488b1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:28.682027 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76634aae-258b-4a23-a867-9030b82488b1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:28.759015 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-76634aae-258b-4a23-a867-9030b82488b1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090480 Oct 24 13:38:28.759615 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 604/1204] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 24 13:38:28 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:38:29.718195 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-5f30e3d1-4a8d-436d-b4e2-8eb2b7d009b5 req-958f2f7c-dfd5-4b0e-a490-ad4e581b3c99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d5d796-9064-416a-9947-0f27ff79e5c0", "tag": "fe775a60-888c-437e-ab0f-adbec1202b69"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:38:29.728030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-5f30e3d1-4a8d-436d-b4e2-8eb2b7d009b5 req-958f2f7c-dfd5-4b0e-a490-ad4e581b3c99 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:29.728535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-5f30e3d1-4a8d-436d-b4e2-8eb2b7d009b5 req-958f2f7c-dfd5-4b0e-a490-ad4e581b3c99 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:29.728966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-5f30e3d1-4a8d-436d-b4e2-8eb2b7d009b5 req-958f2f7c-dfd5-4b0e-a490-ad4e581b3c99 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:29.739682 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-5f30e3d1-4a8d-436d-b4e2-8eb2b7d009b5 req-958f2f7c-dfd5-4b0e-a490-ad4e581b3c99 service nova] Creating event network-changed:fe775a60-888c-437e-ab0f-adbec1202b69 for instance 69d5d796-9064-416a-9947-0f27ff79e5c0 on hv-cinder-86249 Oct 24 13:38:29.745036 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-5f30e3d1-4a8d-436d-b4e2-8eb2b7d009b5 req-958f2f7c-dfd5-4b0e-a490-ad4e581b3c99 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030513 Oct 24 13:38:29.746145 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 601/1205] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:38:51.118574 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=15 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:51.121896 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=15 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:51.122695 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=32 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:51.123234 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=41 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:38:51.128898 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7e3232c7-a9fb-4f61-b236-44bf9739f108 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:51.129390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-7e3232c7-a9fb-4f61-b236-44bf9739f108 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:51.134755 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-4a0c0c80-d23b-44a0-919d-dcb06cce3d75 req-a181061a-d099-4588-81c1-99d1860ee0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25ad1362-6db1-48be-8ddb-3fa0b0f78404", "tag": "70dbb5cd-19fd-4c0e-b47a-955a76e67b6b"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:38:51.142198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7e3232c7-a9fb-4f61-b236-44bf9739f108 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:51.143200 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7e3232c7-a9fb-4f61-b236-44bf9739f108 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:51.143763 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7e3232c7-a9fb-4f61-b236-44bf9739f108 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:51.144488 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7e3232c7-a9fb-4f61-b236-44bf9739f108 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:51.144942 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7e3232c7-a9fb-4f61-b236-44bf9739f108 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:51.145364 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7e3232c7-a9fb-4f61-b236-44bf9739f108 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:51.145505 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-4a0c0c80-d23b-44a0-919d-dcb06cce3d75 req-a181061a-d099-4588-81c1-99d1860ee0c8 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:51.145932 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-4a0c0c80-d23b-44a0-919d-dcb06cce3d75 req-a181061a-d099-4588-81c1-99d1860ee0c8 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:51.146429 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-4a0c0c80-d23b-44a0-919d-dcb06cce3d75 req-a181061a-d099-4588-81c1-99d1860ee0c8 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:51.162659 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-4a0c0c80-d23b-44a0-919d-dcb06cce3d75 req-a181061a-d099-4588-81c1-99d1860ee0c8 service nova] Creating event network-changed:70dbb5cd-19fd-4c0e-b47a-955a76e67b6b for instance 25ad1362-6db1-48be-8ddb-3fa0b0f78404 on hv-cinder-86249 Oct 24 13:38:51.168193 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-4a0c0c80-d23b-44a0-919d-dcb06cce3d75 req-a181061a-d099-4588-81c1-99d1860ee0c8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047570 Oct 24 13:38:51.171963 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 602/1206] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:38:51.173273 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-7e3232c7-a9fb-4f61-b236-44bf9739f108 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Going to try to terminate instance {{(pid=119145) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:38:51.464754 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-7e3232c7-a9fb-4f61-b236-44bf9739f108 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "DELETE /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 204 len: 0 microversion: 2.1 time: 0.347393 Oct 24 13:38:51.467618 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 605/1207] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:38:51 2022] DELETE /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:38:51.474378 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-2c2b4334-8e4e-4acd-8d67-aab2a682200e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:51.475072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-2c2b4334-8e4e-4acd-8d67-aab2a682200e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:51.482571 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2c2b4334-8e4e-4acd-8d67-aab2a682200e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:51.483054 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2c2b4334-8e4e-4acd-8d67-aab2a682200e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:51.483596 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2c2b4334-8e4e-4acd-8d67-aab2a682200e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:51.484637 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2c2b4334-8e4e-4acd-8d67-aab2a682200e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:51.485082 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2c2b4334-8e4e-4acd-8d67-aab2a682200e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:51.485686 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2c2b4334-8e4e-4acd-8d67-aab2a682200e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:51.693288 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-2c2b4334-8e4e-4acd-8d67-aab2a682200e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:51.701462 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-2c2b4334-8e4e-4acd-8d67-aab2a682200e tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1566 microversion: 2.1 time: 0.231215 Oct 24 13:38:51.720740 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 603/1208] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:51 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1566 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:52.726845 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-36a0b666-ba1a-49cf-a5de-d6a60f3f1218 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:52.727767 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-36a0b666-ba1a-49cf-a5de-d6a60f3f1218 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:52.734323 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-36a0b666-ba1a-49cf-a5de-d6a60f3f1218 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:52.734802 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-36a0b666-ba1a-49cf-a5de-d6a60f3f1218 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:52.735228 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-36a0b666-ba1a-49cf-a5de-d6a60f3f1218 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:52.736112 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-36a0b666-ba1a-49cf-a5de-d6a60f3f1218 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:52.736927 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-36a0b666-ba1a-49cf-a5de-d6a60f3f1218 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:52.737355 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-36a0b666-ba1a-49cf-a5de-d6a60f3f1218 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:52.871718 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-36a0b666-ba1a-49cf-a5de-d6a60f3f1218 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:52.879955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-36a0b666-ba1a-49cf-a5de-d6a60f3f1218 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1566 microversion: 2.1 time: 0.158171 Oct 24 13:38:52.880565 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 606/1209] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:52 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:53.878384 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-e88ac787-3497-4509-8ce8-607855882710 req-6728b53d-96af-43e9-a75c-efd6d482942e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25ad1362-6db1-48be-8ddb-3fa0b0f78404", "name": "network-vif-deleted", "tag": "70dbb5cd-19fd-4c0e-b47a-955a76e67b6b"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:38:53.889000 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-e88ac787-3497-4509-8ce8-607855882710 req-6728b53d-96af-43e9-a75c-efd6d482942e service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:53.889460 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-e88ac787-3497-4509-8ce8-607855882710 req-6728b53d-96af-43e9-a75c-efd6d482942e service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:53.889877 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-e88ac787-3497-4509-8ce8-607855882710 req-6728b53d-96af-43e9-a75c-efd6d482942e service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:53.901032 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-e88ac787-3497-4509-8ce8-607855882710 req-6728b53d-96af-43e9-a75c-efd6d482942e service nova] Creating event network-vif-deleted:70dbb5cd-19fd-4c0e-b47a-955a76e67b6b for instance 25ad1362-6db1-48be-8ddb-3fa0b0f78404 on hv-cinder-86249 Oct 24 13:38:53.904642 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6b1f2ff6-f149-43b6-8b66-fc2574c2d518 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:53.905333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-6b1f2ff6-f149-43b6-8b66-fc2574c2d518 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:53.906142 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-e88ac787-3497-4509-8ce8-607855882710 req-6728b53d-96af-43e9-a75c-efd6d482942e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032326 Oct 24 13:38:53.906934 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 604/1210] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:38:53.912705 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6b1f2ff6-f149-43b6-8b66-fc2574c2d518 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:53.913242 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6b1f2ff6-f149-43b6-8b66-fc2574c2d518 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:53.913759 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6b1f2ff6-f149-43b6-8b66-fc2574c2d518 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:53.914445 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6b1f2ff6-f149-43b6-8b66-fc2574c2d518 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:53.914889 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6b1f2ff6-f149-43b6-8b66-fc2574c2d518 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:53.915306 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6b1f2ff6-f149-43b6-8b66-fc2574c2d518 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:53.979868 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-6b1f2ff6-f149-43b6-8b66-fc2574c2d518 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:53.988358 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6b1f2ff6-f149-43b6-8b66-fc2574c2d518 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1382 microversion: 2.1 time: 0.087175 Oct 24 13:38:53.992465 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 607/1211] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:53 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1382 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:38:55.012730 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-6076e57d-baba-4205-8405-8c6d5b8b99e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:55.013426 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-6076e57d-baba-4205-8405-8c6d5b8b99e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:55.019966 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6076e57d-baba-4205-8405-8c6d5b8b99e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:55.020475 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6076e57d-baba-4205-8405-8c6d5b8b99e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:55.020901 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6076e57d-baba-4205-8405-8c6d5b8b99e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:55.021573 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6076e57d-baba-4205-8405-8c6d5b8b99e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:55.022012 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6076e57d-baba-4205-8405-8c6d5b8b99e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:55.022431 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6076e57d-baba-4205-8405-8c6d5b8b99e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:55.052134 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6076e57d-baba-4205-8405-8c6d5b8b99e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:55.052634 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6076e57d-baba-4205-8405-8c6d5b8b99e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:55.053057 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6076e57d-baba-4205-8405-8c6d5b8b99e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:55.053486 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.objects.instance [None req-6076e57d-baba-4205-8405-8c6d5b8b99e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lazy-loading 'fault' on Instance uuid 25ad1362-6db1-48be-8ddb-3fa0b0f78404 {{(pid=119146) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:38:55.095252 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6076e57d-baba-4205-8405-8c6d5b8b99e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33af9a4e3c29426b90dfd5abebde5ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a946788afc074f079618f1a848ec0f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:38:55.103498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-6076e57d-baba-4205-8405-8c6d5b8b99e2 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 200 len: 1224 microversion: 2.1 time: 0.094979 Oct 24 13:38:55.104066 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 605/1212] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:55 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:38:56.127524 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-980dd6a8-5736-45aa-8fa5-7a914945b246 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:56.128164 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-980dd6a8-5736-45aa-8fa5-7a914945b246 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] [instance: 25ad1362-6db1-48be-8ddb-3fa0b0f78404] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:38:56.135123 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-980dd6a8-5736-45aa-8fa5-7a914945b246 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:56.135593 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-980dd6a8-5736-45aa-8fa5-7a914945b246 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:56.136016 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-980dd6a8-5736-45aa-8fa5-7a914945b246 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:56.136720 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-980dd6a8-5736-45aa-8fa5-7a914945b246 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:38:56.137168 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-980dd6a8-5736-45aa-8fa5-7a914945b246 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:38:56.137585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-980dd6a8-5736-45aa-8fa5-7a914945b246 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:38:56.151217 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-980dd6a8-5736-45aa-8fa5-7a914945b246 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] HTTP exception thrown: Instance 25ad1362-6db1-48be-8ddb-3fa0b0f78404 could not be found. Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-980dd6a8-5736-45aa-8fa5-7a914945b246 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Request method failure captured: Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 HTTP/1.1 Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpQP1IYKkRekHDzSuN9rfuCbukiiWxMtMc2Gu3HcGZ2GkZvd6F_UYay-GlczUyfRU-NThTI-b-etWnNOOI2XeC36RO6T_ZRWrlXLlntXfngC9U4Qi7Fu3obeyKsUu-l5My55pMIlQwXVqh2DRcP59emjAE5DDjdbGcOBN1lInCtMRJE Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: a946788afc074f079618f1a848ec0f8c Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-TestShelveInstance-1192339842 Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:38:56.152864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:38:56.154586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a946788afc074f079618f1a848ec0f8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a946788afc074f079618f1a848ec0f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a946788afc074f079618f1a848ec0f8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a946788afc074f079618f1a848ec0f8c"}]}] Oct 24 13:38:56.154586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-TestShelveInstance-1192339842 Oct 24 13:38:56.154586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: a946788afc074f079618f1a848ec0f8c Oct 24 13:38:56.154586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-TestShelveInstance-1192339842 Oct 24 13:38:56.154586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-TestShelveInstance-1192339842-project Oct 24 13:38:56.154586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:38:56.154586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:38:56.154586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 33af9a4e3c29426b90dfd5abebde5ed4 Oct 24 13:38:56.154586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-TestShelveInstance-1192339842-project Oct 24 13:38:56.154586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:38:56.154586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance 25ad1362-6db1-48be-8ddb-3fa0b0f78404 could not be found. Oct 24 13:38:56.154586 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': '25ad1362-6db1-48be-8ddb-3fa0b0f78404'} Oct 24 13:38:56.155601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:38:56.155601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:38:56.155601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:38:56.155601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:38:56.155601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:38:56.155601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:38:56.155601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:38:56.155601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:38:56.155601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:38:56.155601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:38:56.155601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25ad1362-6db1-48be-8ddb-3fa0b0f78404 could not be found. Oct 24 13:38:56.155601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:38:56.155601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:38:56.155601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:38:56.155601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:38:56.155601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:38:56.155601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:38:56.155601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:38:56.155601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:38:56.155601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:38:56.157218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:38:56.157218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:38:56.157218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:38:56.157218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:38:56.157218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:38:56.157218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:38:56.157218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:38:56.157218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25ad1362-6db1-48be-8ddb-3fa0b0f78404 could not be found. Oct 24 13:38:56.157218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:38:56.157218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:38:56.157218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:38:56.157218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:38:56.157218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:38:56.157218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:38:56.157218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:38:56.157218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:38:56.157218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25ad1362-6db1-48be-8ddb-3fa0b0f78404 could not be found. Oct 24 13:38:56.157218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:38:56.158630 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-980dd6a8-5736-45aa-8fa5-7a914945b246 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Returning 404 to user: Instance 25ad1362-6db1-48be-8ddb-3fa0b0f78404 could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:38:56.158630 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-980dd6a8-5736-45aa-8fa5-7a914945b246 tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404" status: 404 len: 111 microversion: 2.1 time: 0.030581 Oct 24 13:38:56.158630 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 608/1213] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:38:56 2022] GET /compute/v2.1/servers/25ad1362-6db1-48be-8ddb-3fa0b0f78404 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:38:56.383404 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-fd9e8422-18f5-4080-b315-c359576d767f tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] Calling method '.version_select at 0x7f17a821a790>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:38:56.465193 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-fd9e8422-18f5-4080-b315-c359576d767f tempest-TestShelveInstance-1192339842 tempest-TestShelveInstance-1192339842-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-615995550" status: 202 len: 0 microversion: 2.1 time: 0.086142 Oct 24 13:38:56.465782 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 606/1214] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 24 13:38:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-615995550 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:39:44.793153 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-54bba274-b6be-4911-9ad0-1a03cac509e6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:44.793647 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-54bba274-b6be-4911-9ad0-1a03cac509e6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:39:44.795740 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:39:44.796451 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:39:44.801876 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-54bba274-b6be-4911-9ad0-1a03cac509e6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:44.802357 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-54bba274-b6be-4911-9ad0-1a03cac509e6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:44.802788 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-54bba274-b6be-4911-9ad0-1a03cac509e6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:44.803469 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-54bba274-b6be-4911-9ad0-1a03cac509e6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:44.803943 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-54bba274-b6be-4911-9ad0-1a03cac509e6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:44.804387 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-54bba274-b6be-4911-9ad0-1a03cac509e6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:44.827303 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-54bba274-b6be-4911-9ad0-1a03cac509e6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0/ips" status: 200 len: 148 microversion: 2.1 time: 0.038825 Oct 24 13:39:44.827861 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 609/1215] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 24 13:39:44 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:39:44.845857 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=18 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:39:44.846701 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:39:44.851102 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e2ae6cdb-82cc-43a7-877a-594547686e33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65d2dfe6-01d7-4e10-86ca-75a052f862fe"}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:39:44.853400 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e2ae6cdb-82cc-43a7-877a-594547686e33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:39:44.860683 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e2ae6cdb-82cc-43a7-877a-594547686e33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:44.861164 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e2ae6cdb-82cc-43a7-877a-594547686e33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:44.861595 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e2ae6cdb-82cc-43a7-877a-594547686e33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:44.862307 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e2ae6cdb-82cc-43a7-877a-594547686e33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:44.862756 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e2ae6cdb-82cc-43a7-877a-594547686e33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:44.863174 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e2ae6cdb-82cc-43a7-877a-594547686e33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:44.940672 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-e2ae6cdb-82cc-43a7-877a-594547686e33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] HTTP exception thrown: Invalid volume: volume 65d2dfe6-01d7-4e10-86ca-75a052f862fe is already attached to instances: 604ec880-17e0-4294-9b1e-b57ce613c990 Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e2ae6cdb-82cc-43a7-877a-594547686e33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Request method failure captured: Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: POST /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0/os-volume_attachments HTTP/1.1 Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 74 Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpTbRRXQSAKwonVGeChkQxnwDI7hnY-9OBoe_qnbtdeMF_9XlbOZKw0JbfEXuhVi4scmDs_GUKvJoTXwlczS-zmtlXzqna6piOiITjfrb2p2E7hfxVXwAjE0Dt7XmIWSB362Q5Fsw_cewEhIEFbVblBQ6zgqJNdaeZDZqts2BcPdRJc Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:39:44.945880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:39:44.947947 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0a7896472f034eb4b3b028d528cfbac0"}]}] Oct 24 13:39:44.947947 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:39:44.947947 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:39:44.947947 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:39:44.947947 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:39:44.947947 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:39:44.947947 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:39:44.947947 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 54fcced6d8d943608b940d1dab001540 Oct 24 13:39:44.947947 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:39:44.947947 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Oct 24 13:39:44.947947 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {"volumeAttachment": {"volumeId": "65d2dfe6-01d7-4e10-86ca-75a052f862fe"}} Oct 24 13:39:44.947947 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:39:44.949004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Invalid volume: volume 65d2dfe6-01d7-4e10-86ca-75a052f862fe is already attached to instances: 604ec880-17e0-4294-9b1e-b57ce613c990 Oct 24 13:39:44.949004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'server_id': '69d5d796-9064-416a-9947-0f27ff79e5c0', 'body': {'volumeAttachment': {'volumeId': '65d2dfe6-01d7-4e10-86ca-75a052f862fe'}}} Oct 24 13:39:44.949004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:39:44.949004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:39:44.949004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 24 13:39:44.949004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 24 13:39:44.949004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 13:39:44.949004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 13:39:44.949004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 24 13:39:44.949004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 13:39:44.949004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 24 13:39:44.949004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 24 13:39:44.949004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 24 13:39:44.949004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 24 13:39:44.949004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 65d2dfe6-01d7-4e10-86ca-75a052f862fe is already attached to instances: 604ec880-17e0-4294-9b1e-b57ce613c990 Oct 24 13:39:44.949004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:39:44.949004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:39:44.949004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:39:44.949004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:39:44.950719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:39:44.950719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:39:44.950719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:39:44.950719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:39:44.950719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:39:44.950719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:39:44.950719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:39:44.950719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:39:44.950719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:39:44.950719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:39:44.950719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:39:44.950719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:39:44.950719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 24 13:39:44.950719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 24 13:39:44.950719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 65d2dfe6-01d7-4e10-86ca-75a052f862fe is already attached to instances: 604ec880-17e0-4294-9b1e-b57ce613c990 Oct 24 13:39:44.950719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:39:44.950719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:39:44.950719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:39:44.950719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:39:44.950719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:39:44.952352 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:39:44.952352 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:39:44.952352 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:39:44.952352 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 65d2dfe6-01d7-4e10-86ca-75a052f862fe is already attached to instances: 604ec880-17e0-4294-9b1e-b57ce613c990 Oct 24 13:39:44.952352 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:39:44.952352 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e2ae6cdb-82cc-43a7-877a-594547686e33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Returning 400 to user: Invalid volume: volume 65d2dfe6-01d7-4e10-86ca-75a052f862fe is already attached to instances: 604ec880-17e0-4294-9b1e-b57ce613c990 {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:39:44.952352 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e2ae6cdb-82cc-43a7-877a-594547686e33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "POST /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099623 Oct 24 13:39:44.952352 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 607/1216] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 24 13:39:44 2022] POST /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:39:44.953458 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-d54bb28d-383d-441c-a27b-da3b159fe05b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:44.953934 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-d54bb28d-383d-441c-a27b-da3b159fe05b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:39:44.960917 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d54bb28d-383d-441c-a27b-da3b159fe05b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:44.962056 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d54bb28d-383d-441c-a27b-da3b159fe05b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:44.962056 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d54bb28d-383d-441c-a27b-da3b159fe05b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:44.962473 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d54bb28d-383d-441c-a27b-da3b159fe05b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:44.962921 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d54bb28d-383d-441c-a27b-da3b159fe05b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:44.963340 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d54bb28d-383d-441c-a27b-da3b159fe05b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:44.988546 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-d54bb28d-383d-441c-a27b-da3b159fe05b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Going to try to terminate instance {{(pid=119145) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:39:45.303095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-d54bb28d-383d-441c-a27b-da3b159fe05b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "DELETE /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 204 len: 0 microversion: 2.1 time: 0.353630 Oct 24 13:39:45.303687 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 610/1217] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:39:44 2022] DELETE /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:39:45.312164 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-59f78bda-ad1e-474a-952b-8f8f20e093e9 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:45.312807 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-59f78bda-ad1e-474a-952b-8f8f20e093e9 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:39:45.319518 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-59f78bda-ad1e-474a-952b-8f8f20e093e9 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:45.324378 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-59f78bda-ad1e-474a-952b-8f8f20e093e9 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:45.324378 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-59f78bda-ad1e-474a-952b-8f8f20e093e9 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:45.324378 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-59f78bda-ad1e-474a-952b-8f8f20e093e9 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:45.324378 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-59f78bda-ad1e-474a-952b-8f8f20e093e9 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:45.324765 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-59f78bda-ad1e-474a-952b-8f8f20e093e9 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:45.449092 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-59f78bda-ad1e-474a-952b-8f8f20e093e9 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:39:45.456684 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-59f78bda-ad1e-474a-952b-8f8f20e093e9 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 200 len: 1680 microversion: 2.1 time: 0.148686 Oct 24 13:39:45.457250 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 608/1218] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:39:45 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:39:46.480063 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-2efbefa9-00a5-4c27-8957-fa8ffdb0a0f6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:46.480786 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-2efbefa9-00a5-4c27-8957-fa8ffdb0a0f6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:39:46.487143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2efbefa9-00a5-4c27-8957-fa8ffdb0a0f6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:46.487610 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2efbefa9-00a5-4c27-8957-fa8ffdb0a0f6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:46.488027 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2efbefa9-00a5-4c27-8957-fa8ffdb0a0f6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:46.488735 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2efbefa9-00a5-4c27-8957-fa8ffdb0a0f6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:46.489176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2efbefa9-00a5-4c27-8957-fa8ffdb0a0f6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:46.489587 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2efbefa9-00a5-4c27-8957-fa8ffdb0a0f6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:46.620112 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-2efbefa9-00a5-4c27-8957-fa8ffdb0a0f6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:39:46.628407 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-2efbefa9-00a5-4c27-8957-fa8ffdb0a0f6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 200 len: 1680 microversion: 2.1 time: 0.152538 Oct 24 13:39:46.628983 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 611/1219] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:39:46 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:39:47.652301 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-2f3b081a-ed38-49ee-8619-9a770c174235 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:47.652896 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-2f3b081a-ed38-49ee-8619-9a770c174235 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:39:47.659535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2f3b081a-ed38-49ee-8619-9a770c174235 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:47.660004 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2f3b081a-ed38-49ee-8619-9a770c174235 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:47.660457 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2f3b081a-ed38-49ee-8619-9a770c174235 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:47.661151 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2f3b081a-ed38-49ee-8619-9a770c174235 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:47.661621 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2f3b081a-ed38-49ee-8619-9a770c174235 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:47.662072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2f3b081a-ed38-49ee-8619-9a770c174235 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:47.726700 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-2f3b081a-ed38-49ee-8619-9a770c174235 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:39:47.735280 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-2f3b081a-ed38-49ee-8619-9a770c174235 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 200 len: 1612 microversion: 2.1 time: 0.086939 Oct 24 13:39:47.735861 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 609/1220] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:39:47 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 1612 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:39:48.004800 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-8d7233df-8e5e-4b27-9476-56f695d564a1 req-1e7cf0c6-1046-468e-99e5-7ee6b9f79386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d5d796-9064-416a-9947-0f27ff79e5c0", "name": "network-vif-deleted", "tag": "fe775a60-888c-437e-ab0f-adbec1202b69"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:39:48.015121 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-8d7233df-8e5e-4b27-9476-56f695d564a1 req-1e7cf0c6-1046-468e-99e5-7ee6b9f79386 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:48.015593 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-8d7233df-8e5e-4b27-9476-56f695d564a1 req-1e7cf0c6-1046-468e-99e5-7ee6b9f79386 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:48.016019 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-8d7233df-8e5e-4b27-9476-56f695d564a1 req-1e7cf0c6-1046-468e-99e5-7ee6b9f79386 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:48.027572 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-8d7233df-8e5e-4b27-9476-56f695d564a1 req-1e7cf0c6-1046-468e-99e5-7ee6b9f79386 service nova] Creating event network-vif-deleted:fe775a60-888c-437e-ab0f-adbec1202b69 for instance 69d5d796-9064-416a-9947-0f27ff79e5c0 on hv-cinder-86249 Oct 24 13:39:48.032404 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-8d7233df-8e5e-4b27-9476-56f695d564a1 req-1e7cf0c6-1046-468e-99e5-7ee6b9f79386 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032450 Oct 24 13:39:48.032997 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 612/1221] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:39:48.758905 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-cabf2253-9d4d-41bf-82a2-4f82b5dd80a4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:48.760704 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-cabf2253-9d4d-41bf-82a2-4f82b5dd80a4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:39:48.772399 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cabf2253-9d4d-41bf-82a2-4f82b5dd80a4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:48.779594 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cabf2253-9d4d-41bf-82a2-4f82b5dd80a4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:48.779594 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cabf2253-9d4d-41bf-82a2-4f82b5dd80a4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:48.779594 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cabf2253-9d4d-41bf-82a2-4f82b5dd80a4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:48.779594 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cabf2253-9d4d-41bf-82a2-4f82b5dd80a4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:48.780002 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cabf2253-9d4d-41bf-82a2-4f82b5dd80a4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:48.806328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cabf2253-9d4d-41bf-82a2-4f82b5dd80a4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:48.806818 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cabf2253-9d4d-41bf-82a2-4f82b5dd80a4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:48.807251 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-cabf2253-9d4d-41bf-82a2-4f82b5dd80a4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:48.808227 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.objects.instance [None req-cabf2253-9d4d-41bf-82a2-4f82b5dd80a4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lazy-loading 'fault' on Instance uuid 69d5d796-9064-416a-9947-0f27ff79e5c0 {{(pid=119146) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:39:48.855308 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-cabf2253-9d4d-41bf-82a2-4f82b5dd80a4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:39:48.874141 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-cabf2253-9d4d-41bf-82a2-4f82b5dd80a4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 200 len: 1331 microversion: 2.1 time: 0.119018 Oct 24 13:39:48.874990 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 610/1222] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:39:48 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 1331 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:39:49.901327 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-14cd63c9-27d2-42e5-9ec7-31e814e95b6c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:49.902378 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-14cd63c9-27d2-42e5-9ec7-31e814e95b6c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:39:49.909200 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-14cd63c9-27d2-42e5-9ec7-31e814e95b6c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:49.909667 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-14cd63c9-27d2-42e5-9ec7-31e814e95b6c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:49.910132 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-14cd63c9-27d2-42e5-9ec7-31e814e95b6c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:49.910826 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-14cd63c9-27d2-42e5-9ec7-31e814e95b6c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:49.911343 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-14cd63c9-27d2-42e5-9ec7-31e814e95b6c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:49.911758 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-14cd63c9-27d2-42e5-9ec7-31e814e95b6c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:49.926023 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-14cd63c9-27d2-42e5-9ec7-31e814e95b6c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] HTTP exception thrown: Instance 69d5d796-9064-416a-9947-0f27ff79e5c0 could not be found. Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-14cd63c9-27d2-42e5-9ec7-31e814e95b6c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Request method failure captured: Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 HTTP/1.1 Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpTbRRXQSAKwonVGeChkQxnwDI7hnY-9OBoe_qnbtdeMF_9XlbOZKw0JbfEXuhVi4scmDs_GUKvJoTXwlczS-zmtlXzqna6piOiITjfrb2p2E7hfxVXwAjE0Dt7XmIWSB362Q5Fsw_cewEhIEFbVblBQ6zgqJNdaeZDZqts2BcPdRJc Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:39:49.927736 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:39:49.929436 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0a7896472f034eb4b3b028d528cfbac0"}]}] Oct 24 13:39:49.929436 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:39:49.929436 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:39:49.929436 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:39:49.929436 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:39:49.929436 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:39:49.929436 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:39:49.929436 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 54fcced6d8d943608b940d1dab001540 Oct 24 13:39:49.929436 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:39:49.929436 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:39:49.929436 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance 69d5d796-9064-416a-9947-0f27ff79e5c0 could not be found. Oct 24 13:39:49.929436 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': '69d5d796-9064-416a-9947-0f27ff79e5c0'} Oct 24 13:39:49.930594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:39:49.930594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:39:49.930594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:39:49.930594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:39:49.930594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:39:49.930594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:39:49.930594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:39:49.930594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:39:49.930594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:39:49.930594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:39:49.930594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69d5d796-9064-416a-9947-0f27ff79e5c0 could not be found. Oct 24 13:39:49.930594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:39:49.930594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:39:49.930594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:39:49.930594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:39:49.930594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:39:49.930594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:39:49.930594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:39:49.930594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:39:49.930594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:39:49.931967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:39:49.931967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:39:49.931967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:39:49.931967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:39:49.931967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:39:49.931967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:39:49.931967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:39:49.931967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69d5d796-9064-416a-9947-0f27ff79e5c0 could not be found. Oct 24 13:39:49.931967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:39:49.931967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:39:49.931967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:39:49.931967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:39:49.931967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:39:49.931967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:39:49.931967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:39:49.931967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:39:49.931967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69d5d796-9064-416a-9947-0f27ff79e5c0 could not be found. Oct 24 13:39:49.931967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:39:49.934864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-14cd63c9-27d2-42e5-9ec7-31e814e95b6c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Returning 404 to user: Instance 69d5d796-9064-416a-9947-0f27ff79e5c0 could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:39:49.934864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-14cd63c9-27d2-42e5-9ec7-31e814e95b6c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 404 len: 111 microversion: 2.1 time: 0.033618 Oct 24 13:39:49.934864 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 613/1223] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:39:49 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:39:49.938411 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-2329b902-c38c-4969-b68b-3db637275a56 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '.version_select at 0x7f17a3fe1dc0>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:50.012644 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-2329b902-c38c-4969-b68b-3db637275a56 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1396384279" status: 202 len: 0 microversion: 2.1 time: 0.077876 Oct 24 13:39:50.013214 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 611/1224] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 24 13:39:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1396384279 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:39:51.027745 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ce71bb07-a9be-42bf-9057-bf52a555ba76 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:51.028310 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ce71bb07-a9be-42bf-9057-bf52a555ba76 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:39:51.034622 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ce71bb07-a9be-42bf-9057-bf52a555ba76 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:51.035123 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ce71bb07-a9be-42bf-9057-bf52a555ba76 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:51.035541 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ce71bb07-a9be-42bf-9057-bf52a555ba76 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:51.036210 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ce71bb07-a9be-42bf-9057-bf52a555ba76 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:51.036684 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ce71bb07-a9be-42bf-9057-bf52a555ba76 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:51.037095 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ce71bb07-a9be-42bf-9057-bf52a555ba76 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:51.118816 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.objects.instance [None req-ce71bb07-a9be-42bf-9057-bf52a555ba76 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lazy-loading 'services' on Instance uuid 604ec880-17e0-4294-9b1e-b57ce613c990 {{(pid=119145) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:39:51.296618 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ce71bb07-a9be-42bf-9057-bf52a555ba76 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "DELETE /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990/os-volume_attachments/65d2dfe6-01d7-4e10-86ca-75a052f862fe" status: 202 len: 0 microversion: 2.1 time: 0.272573 Oct 24 13:39:51.297148 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 614/1225] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 24 13:39:51 2022] DELETE /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990/os-volume_attachments/65d2dfe6-01d7-4e10-86ca-75a052f862fe => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:39:51.306235 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1d955bab-deee-4b37-b9f1-3f8b74493b98 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:51.309043 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-1d955bab-deee-4b37-b9f1-3f8b74493b98 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:39:51.317910 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1d955bab-deee-4b37-b9f1-3f8b74493b98 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:51.318397 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1d955bab-deee-4b37-b9f1-3f8b74493b98 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:51.318833 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1d955bab-deee-4b37-b9f1-3f8b74493b98 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:51.319532 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1d955bab-deee-4b37-b9f1-3f8b74493b98 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:51.319986 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1d955bab-deee-4b37-b9f1-3f8b74493b98 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:51.320506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1d955bab-deee-4b37-b9f1-3f8b74493b98 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:51.348997 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1d955bab-deee-4b37-b9f1-3f8b74493b98 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047508 Oct 24 13:39:51.349554 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 612/1226] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 24 13:39:51 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:39:52.362474 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9b9b6947-b979-4d66-bfb8-c75b8b840afe tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:52.365013 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9b9b6947-b979-4d66-bfb8-c75b8b840afe tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:39:52.371747 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9b9b6947-b979-4d66-bfb8-c75b8b840afe tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:52.372213 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9b9b6947-b979-4d66-bfb8-c75b8b840afe tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:52.372661 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9b9b6947-b979-4d66-bfb8-c75b8b840afe tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:52.373328 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9b9b6947-b979-4d66-bfb8-c75b8b840afe tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:52.373811 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9b9b6947-b979-4d66-bfb8-c75b8b840afe tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:52.374220 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9b9b6947-b979-4d66-bfb8-c75b8b840afe tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:52.403629 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9b9b6947-b979-4d66-bfb8-c75b8b840afe tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046051 Oct 24 13:39:52.404170 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 615/1227] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 24 13:39:52 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:39:53.415861 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-35fe6890-9ead-4b74-badd-ab243f2a554f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:53.418648 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-35fe6890-9ead-4b74-badd-ab243f2a554f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:39:53.424784 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-35fe6890-9ead-4b74-badd-ab243f2a554f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:53.425255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-35fe6890-9ead-4b74-badd-ab243f2a554f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:53.425679 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-35fe6890-9ead-4b74-badd-ab243f2a554f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:53.426431 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-35fe6890-9ead-4b74-badd-ab243f2a554f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:53.426879 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-35fe6890-9ead-4b74-badd-ab243f2a554f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:53.427293 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-35fe6890-9ead-4b74-badd-ab243f2a554f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:53.455551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-35fe6890-9ead-4b74-badd-ab243f2a554f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043633 Oct 24 13:39:53.456087 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 613/1228] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 24 13:39:53 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:39:53.519255 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b77cb48e-8124-4685-b359-89c58ad4eb8d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:53.519816 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b77cb48e-8124-4685-b359-89c58ad4eb8d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:39:53.526286 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b77cb48e-8124-4685-b359-89c58ad4eb8d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:53.526760 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b77cb48e-8124-4685-b359-89c58ad4eb8d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:53.527189 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b77cb48e-8124-4685-b359-89c58ad4eb8d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:53.527868 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b77cb48e-8124-4685-b359-89c58ad4eb8d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:53.528345 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b77cb48e-8124-4685-b359-89c58ad4eb8d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:53.528768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b77cb48e-8124-4685-b359-89c58ad4eb8d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:53.553695 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b77cb48e-8124-4685-b359-89c58ad4eb8d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Going to try to terminate instance {{(pid=119145) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:39:53.782779 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b77cb48e-8124-4685-b359-89c58ad4eb8d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "DELETE /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990" status: 204 len: 0 microversion: 2.1 time: 0.267025 Oct 24 13:39:53.783328 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 616/1229] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:39:53 2022] DELETE /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:39:53.796167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f4141213-188b-4311-a159-0c87c59b82ac tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:53.796816 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f4141213-188b-4311-a159-0c87c59b82ac tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:39:53.802635 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f4141213-188b-4311-a159-0c87c59b82ac tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:53.803111 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f4141213-188b-4311-a159-0c87c59b82ac tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:53.803564 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f4141213-188b-4311-a159-0c87c59b82ac tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:53.804229 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f4141213-188b-4311-a159-0c87c59b82ac tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:53.804707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f4141213-188b-4311-a159-0c87c59b82ac tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:53.805127 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f4141213-188b-4311-a159-0c87c59b82ac tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:53.932860 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f4141213-188b-4311-a159-0c87c59b82ac tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:39:53.940510 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f4141213-188b-4311-a159-0c87c59b82ac tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990" status: 200 len: 1682 microversion: 2.1 time: 0.148695 Oct 24 13:39:53.941077 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 614/1230] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:39:53 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:39:54.963816 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-33c183c7-409d-4a63-b724-fac53ee9c2d2 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:54.964476 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-33c183c7-409d-4a63-b724-fac53ee9c2d2 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:39:54.970968 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-33c183c7-409d-4a63-b724-fac53ee9c2d2 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:54.971443 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-33c183c7-409d-4a63-b724-fac53ee9c2d2 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:54.971871 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-33c183c7-409d-4a63-b724-fac53ee9c2d2 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:54.972578 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-33c183c7-409d-4a63-b724-fac53ee9c2d2 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:54.973027 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-33c183c7-409d-4a63-b724-fac53ee9c2d2 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:54.973445 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-33c183c7-409d-4a63-b724-fac53ee9c2d2 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:55.101977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-33c183c7-409d-4a63-b724-fac53ee9c2d2 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:39:55.110279 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-33c183c7-409d-4a63-b724-fac53ee9c2d2 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990" status: 200 len: 1682 microversion: 2.1 time: 0.150871 Oct 24 13:39:55.110843 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 617/1231] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:39:54 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:39:56.133315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-1322b6d7-401f-4f65-93d7-5418cd1d526d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:56.133932 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-1322b6d7-401f-4f65-93d7-5418cd1d526d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:39:56.141217 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1322b6d7-401f-4f65-93d7-5418cd1d526d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:56.141695 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1322b6d7-401f-4f65-93d7-5418cd1d526d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:56.142124 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1322b6d7-401f-4f65-93d7-5418cd1d526d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:56.142822 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1322b6d7-401f-4f65-93d7-5418cd1d526d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:56.143273 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1322b6d7-401f-4f65-93d7-5418cd1d526d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:56.143692 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-1322b6d7-401f-4f65-93d7-5418cd1d526d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:56.273007 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-1322b6d7-401f-4f65-93d7-5418cd1d526d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:39:56.280945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-1322b6d7-401f-4f65-93d7-5418cd1d526d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990" status: 200 len: 1682 microversion: 2.1 time: 0.151513 Oct 24 13:39:56.281515 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 615/1232] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:39:56 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:39:56.635212 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-fd0d129b-3a46-4317-a467-db17d1fcafa3 req-40504068-8f86-4c43-8db1-4a0506ffab84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "604ec880-17e0-4294-9b1e-b57ce613c990", "name": "network-vif-deleted", "tag": "1eb5ffaa-5090-4d35-8d38-63f8817fbd9e"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:39:56.645985 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-fd0d129b-3a46-4317-a467-db17d1fcafa3 req-40504068-8f86-4c43-8db1-4a0506ffab84 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:56.646497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-fd0d129b-3a46-4317-a467-db17d1fcafa3 req-40504068-8f86-4c43-8db1-4a0506ffab84 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:56.646909 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-fd0d129b-3a46-4317-a467-db17d1fcafa3 req-40504068-8f86-4c43-8db1-4a0506ffab84 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:56.660175 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-fd0d129b-3a46-4317-a467-db17d1fcafa3 req-40504068-8f86-4c43-8db1-4a0506ffab84 service nova] Creating event network-vif-deleted:1eb5ffaa-5090-4d35-8d38-63f8817fbd9e for instance 604ec880-17e0-4294-9b1e-b57ce613c990 on hv-cinder-86249 Oct 24 13:39:56.665582 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-fd0d129b-3a46-4317-a467-db17d1fcafa3 req-40504068-8f86-4c43-8db1-4a0506ffab84 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034171 Oct 24 13:39:56.666757 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 618/1233] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:39:57.303068 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b9b8a76a-6e1b-43f2-bd67-15964bc41b33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:57.303751 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b9b8a76a-6e1b-43f2-bd67-15964bc41b33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:39:57.310393 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b9b8a76a-6e1b-43f2-bd67-15964bc41b33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:57.310890 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b9b8a76a-6e1b-43f2-bd67-15964bc41b33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:57.311322 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b9b8a76a-6e1b-43f2-bd67-15964bc41b33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:57.312013 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b9b8a76a-6e1b-43f2-bd67-15964bc41b33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:57.312492 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b9b8a76a-6e1b-43f2-bd67-15964bc41b33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:57.312914 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b9b8a76a-6e1b-43f2-bd67-15964bc41b33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:57.345613 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b9b8a76a-6e1b-43f2-bd67-15964bc41b33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:57.346092 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b9b8a76a-6e1b-43f2-bd67-15964bc41b33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:57.346520 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b9b8a76a-6e1b-43f2-bd67-15964bc41b33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:57.346962 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.objects.instance [None req-b9b8a76a-6e1b-43f2-bd67-15964bc41b33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lazy-loading 'fault' on Instance uuid 604ec880-17e0-4294-9b1e-b57ce613c990 {{(pid=119146) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:39:57.392380 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-b9b8a76a-6e1b-43f2-bd67-15964bc41b33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:39:57.400211 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b9b8a76a-6e1b-43f2-bd67-15964bc41b33 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990" status: 200 len: 1331 microversion: 2.1 time: 0.100941 Oct 24 13:39:57.400837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 616/1234] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:39:57 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:39:58.424325 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7b099d6c-5856-452c-bd2d-f03ce366acb7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:58.425021 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-7b099d6c-5856-452c-bd2d-f03ce366acb7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:39:58.431615 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7b099d6c-5856-452c-bd2d-f03ce366acb7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:58.432078 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7b099d6c-5856-452c-bd2d-f03ce366acb7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:58.432535 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7b099d6c-5856-452c-bd2d-f03ce366acb7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:58.433718 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7b099d6c-5856-452c-bd2d-f03ce366acb7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:58.434159 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7b099d6c-5856-452c-bd2d-f03ce366acb7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:58.434572 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7b099d6c-5856-452c-bd2d-f03ce366acb7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:58.447634 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-7b099d6c-5856-452c-bd2d-f03ce366acb7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] HTTP exception thrown: Instance 604ec880-17e0-4294-9b1e-b57ce613c990 could not be found. Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7b099d6c-5856-452c-bd2d-f03ce366acb7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Request method failure captured: Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 HTTP/1.1 Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpTbRRXQSAKwonVGeChkQxnwDI7hnY-9OBoe_qnbtdeMF_9XlbOZKw0JbfEXuhVi4scmDs_GUKvJoTXwlczS-zmtlXzqna6piOiITjfrb2p2E7hfxVXwAjE0Dt7XmIWSB362Q5Fsw_cewEhIEFbVblBQ6zgqJNdaeZDZqts2BcPdRJc Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:39:58.449894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:39:58.451497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0a7896472f034eb4b3b028d528cfbac0"}]}] Oct 24 13:39:58.451497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:39:58.451497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:39:58.451497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:39:58.451497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:39:58.451497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:39:58.451497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:39:58.451497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 54fcced6d8d943608b940d1dab001540 Oct 24 13:39:58.451497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:39:58.451497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:39:58.451497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance 604ec880-17e0-4294-9b1e-b57ce613c990 could not be found. Oct 24 13:39:58.451497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': '604ec880-17e0-4294-9b1e-b57ce613c990'} Oct 24 13:39:58.452380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:39:58.452380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:39:58.452380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:39:58.452380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:39:58.452380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:39:58.452380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:39:58.452380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:39:58.452380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:39:58.452380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:39:58.452380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:39:58.452380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 604ec880-17e0-4294-9b1e-b57ce613c990 could not be found. Oct 24 13:39:58.452380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:39:58.452380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:39:58.452380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:39:58.452380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:39:58.452380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:39:58.452380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:39:58.452380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:39:58.452380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:39:58.452380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:39:58.453869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:39:58.453869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:39:58.453869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:39:58.453869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:39:58.453869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:39:58.453869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:39:58.453869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:39:58.453869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 604ec880-17e0-4294-9b1e-b57ce613c990 could not be found. Oct 24 13:39:58.453869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:39:58.453869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:39:58.453869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:39:58.453869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:39:58.453869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:39:58.453869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:39:58.453869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:39:58.453869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:39:58.453869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 604ec880-17e0-4294-9b1e-b57ce613c990 could not be found. Oct 24 13:39:58.453869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:39:58.455252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7b099d6c-5856-452c-bd2d-f03ce366acb7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Returning 404 to user: Instance 604ec880-17e0-4294-9b1e-b57ce613c990 could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:39:58.455252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-7b099d6c-5856-452c-bd2d-f03ce366acb7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990" status: 404 len: 111 microversion: 2.1 time: 0.031182 Oct 24 13:39:58.455252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 619/1235] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:39:58 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:39:58.460011 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-528582ff-9905-4b08-86b0-d5a74e0acf70 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '.version_select at 0x7f17a81b0040>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:58.555242 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-528582ff-9905-4b08-86b0-d5a74e0acf70 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1572055490" status: 202 len: 0 microversion: 2.1 time: 0.098996 Oct 24 13:39:58.555741 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 617/1236] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 24 13:39:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1572055490 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:39:59.254949 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6de3bf3f-c8f1-4301-bf57-0990580fb642 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Action: 'create', calling method: .version_select at 0x7f17a3fd1160>, body: {"keypair": {"name": "tempest-keypair-691003414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmcKbKBLwTrIu7AE/NbwdoDgzV7KbYfLCy4fFVs8cZQLOxflzrwi19jx304lXebwNTqVZU8uHfZgdBhkH3Cppcv7BvDMDBigfoLd5GDtdVAzJ17rlVaA+dbKHUc+EPGxw=="}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:39:59.270033 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-6de3bf3f-c8f1-4301-bf57-0990580fb642 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Getting quotas for project 0a7896472f034eb4b3b028d528cfbac0. Resources: {'key_pairs'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:39:59.273827 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-6de3bf3f-c8f1-4301-bf57-0990580fb642 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Getting quotas for user 54fcced6d8d943608b940d1dab001540 and project 0a7896472f034eb4b3b028d528cfbac0. Resources: {'key_pairs'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:39:59.332523 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6de3bf3f-c8f1-4301-bf57-0990580fb642 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.081415 Oct 24 13:39:59.333107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 620/1237] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 24 13:39:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:40:01.495185 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b09ed21f-e3d6-4bf8-9611-53cd2b974088 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-592729182", "imageRef": "1a874490-179e-412c-895e-52b16935c04c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b68375da-958f-473f-9389-64a90da42e86"}], "security_groups": [{"name": "tempest-securitygroup--889386180"}], "key_name": "tempest-keypair-691003414", "user_data": "}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:40:01.598411 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.network.neutron [None req-b09ed21f-e3d6-4bf8-9611-53cd2b974088 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] validate_networks() for [('b68375da-958f-473f-9389-64a90da42e86', None, None, None, None, None)] {{(pid=119146) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:40:01.965789 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-b09ed21f-e3d6-4bf8-9611-53cd2b974088 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Flavor limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:40:01.966259 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-b09ed21f-e3d6-4bf8-9611-53cd2b974088 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Image limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:40:01.966774 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-b09ed21f-e3d6-4bf8-9611-53cd2b974088 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Flavor pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:40:01.967184 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-b09ed21f-e3d6-4bf8-9611-53cd2b974088 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Image pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:40:01.967593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-b09ed21f-e3d6-4bf8-9611-53cd2b974088 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:40:01.976301 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b09ed21f-e3d6-4bf8-9611-53cd2b974088 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:01.976778 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b09ed21f-e3d6-4bf8-9611-53cd2b974088 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:01.977207 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b09ed21f-e3d6-4bf8-9611-53cd2b974088 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:01.977923 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b09ed21f-e3d6-4bf8-9611-53cd2b974088 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:01.978378 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b09ed21f-e3d6-4bf8-9611-53cd2b974088 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:01.978791 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b09ed21f-e3d6-4bf8-9611-53cd2b974088 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:01.995204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-b09ed21f-e3d6-4bf8-9611-53cd2b974088 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Getting quotas for project 0a7896472f034eb4b3b028d528cfbac0. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:40:01.999719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-b09ed21f-e3d6-4bf8-9611-53cd2b974088 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Getting quotas for user 54fcced6d8d943608b940d1dab001540 and project 0a7896472f034eb4b3b028d528cfbac0. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:40:02.010544 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b09ed21f-e3d6-4bf8-9611-53cd2b974088 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Going to run 1 instances... {{(pid=119146) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:40:02.013442 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b09ed21f-e3d6-4bf8-9611-53cd2b974088 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a874490-179e-412c-895e-52b16935c04c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119146) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:40:02.128405 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b09ed21f-e3d6-4bf8-9611-53cd2b974088 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.637970 Oct 24 13:40:02.129087 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 618/1238] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 24 13:40:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 13:40:02.141974 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-4c78b157-729a-4c53-9efe-77ccc60d8fff tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:02.145153 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-4c78b157-729a-4c53-9efe-77ccc60d8fff tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:02.204370 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-4c78b157-729a-4c53-9efe-77ccc60d8fff tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:02.211286 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-4c78b157-729a-4c53-9efe-77ccc60d8fff tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 200 len: 1240 microversion: 2.1 time: 0.075021 Oct 24 13:40:02.211841 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 621/1239] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:02 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:03.233989 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-56317875-9b1e-4348-aa87-9b3f30aefe44 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:03.234667 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-56317875-9b1e-4348-aa87-9b3f30aefe44 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:03.240725 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-56317875-9b1e-4348-aa87-9b3f30aefe44 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:03.241210 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-56317875-9b1e-4348-aa87-9b3f30aefe44 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:03.241648 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-56317875-9b1e-4348-aa87-9b3f30aefe44 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:03.242333 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-56317875-9b1e-4348-aa87-9b3f30aefe44 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:03.242788 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-56317875-9b1e-4348-aa87-9b3f30aefe44 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:03.243213 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-56317875-9b1e-4348-aa87-9b3f30aefe44 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:03.303150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-56317875-9b1e-4348-aa87-9b3f30aefe44 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:03.310714 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-56317875-9b1e-4348-aa87-9b3f30aefe44 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 200 len: 1244 microversion: 2.1 time: 0.080993 Oct 24 13:40:03.311279 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 619/1240] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:03 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:04.334168 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-07a754bb-3c2c-4d30-bc31-a21b47c60bba tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:04.334743 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-07a754bb-3c2c-4d30-bc31-a21b47c60bba tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:04.341196 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-07a754bb-3c2c-4d30-bc31-a21b47c60bba tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:04.341713 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-07a754bb-3c2c-4d30-bc31-a21b47c60bba tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:04.342137 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-07a754bb-3c2c-4d30-bc31-a21b47c60bba tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:04.342806 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-07a754bb-3c2c-4d30-bc31-a21b47c60bba tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:04.343247 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-07a754bb-3c2c-4d30-bc31-a21b47c60bba tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:04.343708 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-07a754bb-3c2c-4d30-bc31-a21b47c60bba tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:04.403641 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-07a754bb-3c2c-4d30-bc31-a21b47c60bba tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:04.411157 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-07a754bb-3c2c-4d30-bc31-a21b47c60bba tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 200 len: 1244 microversion: 2.1 time: 0.081162 Oct 24 13:40:04.411713 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 622/1241] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:04 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:05.433591 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-dcd037fc-cd99-475e-9427-c4edd031321e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:05.434199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-dcd037fc-cd99-475e-9427-c4edd031321e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:05.441167 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dcd037fc-cd99-475e-9427-c4edd031321e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:05.441720 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dcd037fc-cd99-475e-9427-c4edd031321e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:05.442146 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dcd037fc-cd99-475e-9427-c4edd031321e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:05.442818 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dcd037fc-cd99-475e-9427-c4edd031321e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:05.443261 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dcd037fc-cd99-475e-9427-c4edd031321e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:05.443673 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-dcd037fc-cd99-475e-9427-c4edd031321e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:05.505016 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-dcd037fc-cd99-475e-9427-c4edd031321e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:05.512379 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-dcd037fc-cd99-475e-9427-c4edd031321e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 200 len: 1244 microversion: 2.1 time: 0.082620 Oct 24 13:40:05.512974 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 620/1242] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:05 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:06.535087 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ea369e45-7e66-46f7-9bb2-b1e597d74ee1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:06.535695 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ea369e45-7e66-46f7-9bb2-b1e597d74ee1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:06.542279 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ea369e45-7e66-46f7-9bb2-b1e597d74ee1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:06.542753 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ea369e45-7e66-46f7-9bb2-b1e597d74ee1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:06.543176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ea369e45-7e66-46f7-9bb2-b1e597d74ee1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:06.543851 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ea369e45-7e66-46f7-9bb2-b1e597d74ee1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:06.544382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ea369e45-7e66-46f7-9bb2-b1e597d74ee1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:06.544790 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ea369e45-7e66-46f7-9bb2-b1e597d74ee1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:06.610804 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ea369e45-7e66-46f7-9bb2-b1e597d74ee1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:06.618726 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ea369e45-7e66-46f7-9bb2-b1e597d74ee1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 200 len: 1236 microversion: 2.1 time: 0.087475 Oct 24 13:40:06.619308 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 623/1243] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:06 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 1236 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:07.643987 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-52473b41-3005-4879-8e18-febfcec3af3b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:07.645251 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-52473b41-3005-4879-8e18-febfcec3af3b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:07.651538 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-52473b41-3005-4879-8e18-febfcec3af3b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:07.652016 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-52473b41-3005-4879-8e18-febfcec3af3b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:07.652469 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-52473b41-3005-4879-8e18-febfcec3af3b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:07.653150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-52473b41-3005-4879-8e18-febfcec3af3b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:07.654282 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-52473b41-3005-4879-8e18-febfcec3af3b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:07.654738 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-52473b41-3005-4879-8e18-febfcec3af3b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:07.721824 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-52473b41-3005-4879-8e18-febfcec3af3b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:07.729424 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-52473b41-3005-4879-8e18-febfcec3af3b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 200 len: 1298 microversion: 2.1 time: 0.089335 Oct 24 13:40:07.730000 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 621/1244] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:07 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:40:08.752486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8c703e86-7408-4b58-8e7a-415c266ec83f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:08.753125 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-8c703e86-7408-4b58-8e7a-415c266ec83f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:08.759771 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8c703e86-7408-4b58-8e7a-415c266ec83f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:08.760240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8c703e86-7408-4b58-8e7a-415c266ec83f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:08.760699 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8c703e86-7408-4b58-8e7a-415c266ec83f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:08.761372 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8c703e86-7408-4b58-8e7a-415c266ec83f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:08.761809 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8c703e86-7408-4b58-8e7a-415c266ec83f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:08.762320 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8c703e86-7408-4b58-8e7a-415c266ec83f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:08.911064 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-8c703e86-7408-4b58-8e7a-415c266ec83f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:08.918702 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-8c703e86-7408-4b58-8e7a-415c266ec83f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 200 len: 1365 microversion: 2.1 time: 0.170284 Oct 24 13:40:08.919332 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 624/1245] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:08 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:09.004152 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-42200620-8071-45f7-b843-446d47821bcc req-480a4552-ce63-44df-b3bd-f6be977eb075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50390c66-fb8d-4e03-96b9-7dfdc674d94b", "tag": "a803f95f-7afc-42f9-a263-976a6ba10f8f"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:40:09.015549 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-42200620-8071-45f7-b843-446d47821bcc req-480a4552-ce63-44df-b3bd-f6be977eb075 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:09.016372 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-42200620-8071-45f7-b843-446d47821bcc req-480a4552-ce63-44df-b3bd-f6be977eb075 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:09.017369 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-42200620-8071-45f7-b843-446d47821bcc req-480a4552-ce63-44df-b3bd-f6be977eb075 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:09.030735 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-42200620-8071-45f7-b843-446d47821bcc req-480a4552-ce63-44df-b3bd-f6be977eb075 service nova] Creating event network-changed:a803f95f-7afc-42f9-a263-976a6ba10f8f for instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b on hv-cinder-86249 Oct 24 13:40:09.035774 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-42200620-8071-45f7-b843-446d47821bcc req-480a4552-ce63-44df-b3bd-f6be977eb075 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035564 Oct 24 13:40:09.037359 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 622/1246] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:40:09.942819 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-88c8d8ef-b0f3-4c00-b963-5459969583d8 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:09.944223 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-88c8d8ef-b0f3-4c00-b963-5459969583d8 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:09.951275 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-88c8d8ef-b0f3-4c00-b963-5459969583d8 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:09.952355 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-88c8d8ef-b0f3-4c00-b963-5459969583d8 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:09.952784 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-88c8d8ef-b0f3-4c00-b963-5459969583d8 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:09.953467 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-88c8d8ef-b0f3-4c00-b963-5459969583d8 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:09.953917 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-88c8d8ef-b0f3-4c00-b963-5459969583d8 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:09.954361 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-88c8d8ef-b0f3-4c00-b963-5459969583d8 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:10.088391 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-88c8d8ef-b0f3-4c00-b963-5459969583d8 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:10.096720 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-88c8d8ef-b0f3-4c00-b963-5459969583d8 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 200 len: 1365 microversion: 2.1 time: 0.157988 Oct 24 13:40:10.097289 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 625/1247] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:09 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:11.120180 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-72beef5a-35a8-4256-90fe-ca8f1147d63f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:11.121067 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-72beef5a-35a8-4256-90fe-ca8f1147d63f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:11.127474 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72beef5a-35a8-4256-90fe-ca8f1147d63f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:11.127951 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72beef5a-35a8-4256-90fe-ca8f1147d63f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:11.128583 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72beef5a-35a8-4256-90fe-ca8f1147d63f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:11.129296 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72beef5a-35a8-4256-90fe-ca8f1147d63f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:11.129746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72beef5a-35a8-4256-90fe-ca8f1147d63f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:11.130183 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-72beef5a-35a8-4256-90fe-ca8f1147d63f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:11.257990 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-72beef5a-35a8-4256-90fe-ca8f1147d63f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:11.265629 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-72beef5a-35a8-4256-90fe-ca8f1147d63f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 200 len: 1365 microversion: 2.1 time: 0.150378 Oct 24 13:40:11.268766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 623/1248] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:11 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:12.288810 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-d0a63c68-bf16-4c50-89e2-cc16b8542633 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:12.290665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-d0a63c68-bf16-4c50-89e2-cc16b8542633 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:12.292185 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=6 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:40:12.297643 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d0a63c68-bf16-4c50-89e2-cc16b8542633 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:12.298140 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d0a63c68-bf16-4c50-89e2-cc16b8542633 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:12.298621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d0a63c68-bf16-4c50-89e2-cc16b8542633 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:12.299317 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d0a63c68-bf16-4c50-89e2-cc16b8542633 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:12.299764 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d0a63c68-bf16-4c50-89e2-cc16b8542633 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:12.300228 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d0a63c68-bf16-4c50-89e2-cc16b8542633 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:12.320149 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:40:12.427964 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-d0a63c68-bf16-4c50-89e2-cc16b8542633 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:12.435616 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-d0a63c68-bf16-4c50-89e2-cc16b8542633 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 200 len: 1365 microversion: 2.1 time: 0.150708 Oct 24 13:40:12.436807 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 626/1249] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:12 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:13.354314 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8e9a3093-e21f-41bb-8094-6a8c16cf7b0a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1380799331", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-827635155", "security_groups": [{"name": "tempest-secgroup-smoke-14826782"}], "block_device_mapping_v2": [{"uuid": "19edc29d-76e4-4b65-b91a-84f600bada3d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f594f9ca-1fdb-418d-87fd-7e11dd1c7532"}]}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:40:13.364237 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=2 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:40:13.364938 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=6 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:40:13.459152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-56dc6527-c683-4824-9414-306ce0d7e93d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:13.459758 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-56dc6527-c683-4824-9414-306ce0d7e93d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:13.467337 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-56dc6527-c683-4824-9414-306ce0d7e93d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:13.467337 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-56dc6527-c683-4824-9414-306ce0d7e93d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:13.467747 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-56dc6527-c683-4824-9414-306ce0d7e93d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:13.468186 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.network.neutron [None req-8e9a3093-e21f-41bb-8094-6a8c16cf7b0a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] validate_networks() for [('f594f9ca-1fdb-418d-87fd-7e11dd1c7532', None, None, None, None, None)] {{(pid=119146) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:40:13.468497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-56dc6527-c683-4824-9414-306ce0d7e93d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:13.468953 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-56dc6527-c683-4824-9414-306ce0d7e93d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:13.469372 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-56dc6527-c683-4824-9414-306ce0d7e93d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:13.606606 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-56dc6527-c683-4824-9414-306ce0d7e93d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:13.615025 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-56dc6527-c683-4824-9414-306ce0d7e93d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 200 len: 1365 microversion: 2.1 time: 0.159983 Oct 24 13:40:13.615608 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 627/1250] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:13 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:40:13.848103 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-8e9a3093-e21f-41bb-8094-6a8c16cf7b0a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Flavor limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:40:13.848556 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-8e9a3093-e21f-41bb-8094-6a8c16cf7b0a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Image limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:40:13.849031 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-8e9a3093-e21f-41bb-8094-6a8c16cf7b0a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Flavor pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:40:13.849440 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-8e9a3093-e21f-41bb-8094-6a8c16cf7b0a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Image pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:40:13.849916 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-8e9a3093-e21f-41bb-8094-6a8c16cf7b0a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:40:13.859136 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8e9a3093-e21f-41bb-8094-6a8c16cf7b0a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:13.859553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8e9a3093-e21f-41bb-8094-6a8c16cf7b0a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:13.859986 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8e9a3093-e21f-41bb-8094-6a8c16cf7b0a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:13.860741 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8e9a3093-e21f-41bb-8094-6a8c16cf7b0a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:13.861195 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8e9a3093-e21f-41bb-8094-6a8c16cf7b0a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:13.861614 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8e9a3093-e21f-41bb-8094-6a8c16cf7b0a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:13.878534 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-8e9a3093-e21f-41bb-8094-6a8c16cf7b0a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Getting quotas for project 46d41e46b7e3415684c32b22f31eefb5. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:40:13.882407 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-8e9a3093-e21f-41bb-8094-6a8c16cf7b0a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Getting quotas for user cbdf62fbe49d44a58c294ac2c8b22ef5 and project 46d41e46b7e3415684c32b22f31eefb5. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:40:13.939080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8e9a3093-e21f-41bb-8094-6a8c16cf7b0a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Going to run 1 instances... {{(pid=119146) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:40:13.941406 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8e9a3093-e21f-41bb-8094-6a8c16cf7b0a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='19edc29d-76e4-4b65-b91a-84f600bada3d',volume_size=None,volume_type=None)] {{(pid=119146) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:40:14.225029 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8e9a3093-e21f-41bb-8094-6a8c16cf7b0a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.874524 Oct 24 13:40:14.225941 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 624/1251] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 24 13:40:13 2022] POST /compute/v2.1/servers => generated 404 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:40:14.237272 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-fa4f1785-4c10-4e89-9223-c5913dcb92b2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:14.237889 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-fa4f1785-4c10-4e89-9223-c5913dcb92b2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:14.291715 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-fa4f1785-4c10-4e89-9223-c5913dcb92b2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:14.300438 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-fa4f1785-4c10-4e89-9223-c5913dcb92b2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1094 microversion: 2.1 time: 0.067449 Oct 24 13:40:14.301097 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 628/1252] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:14 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:14.638896 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-889ea0fb-e8b7-4a20-baa0-3657b7e576ca tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:14.639982 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-889ea0fb-e8b7-4a20-baa0-3657b7e576ca tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:14.646088 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-889ea0fb-e8b7-4a20-baa0-3657b7e576ca tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:14.646571 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-889ea0fb-e8b7-4a20-baa0-3657b7e576ca tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:14.647008 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-889ea0fb-e8b7-4a20-baa0-3657b7e576ca tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:14.647695 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-889ea0fb-e8b7-4a20-baa0-3657b7e576ca tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:14.648145 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-889ea0fb-e8b7-4a20-baa0-3657b7e576ca tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:14.648596 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-889ea0fb-e8b7-4a20-baa0-3657b7e576ca tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:14.782293 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-889ea0fb-e8b7-4a20-baa0-3657b7e576ca tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:14.789946 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-889ea0fb-e8b7-4a20-baa0-3657b7e576ca tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 200 len: 1365 microversion: 2.1 time: 0.155456 Oct 24 13:40:14.790511 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 625/1253] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:14 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:15.323320 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-89dc369b-f1d4-4642-a8f8-f3433a2f94c3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:15.324155 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-89dc369b-f1d4-4642-a8f8-f3433a2f94c3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:15.330621 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:40:15.332352 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-89dc369b-f1d4-4642-a8f8-f3433a2f94c3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:15.333107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-89dc369b-f1d4-4642-a8f8-f3433a2f94c3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:15.333566 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-89dc369b-f1d4-4642-a8f8-f3433a2f94c3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:15.334295 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-89dc369b-f1d4-4642-a8f8-f3433a2f94c3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:15.334742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-89dc369b-f1d4-4642-a8f8-f3433a2f94c3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:15.335161 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-89dc369b-f1d4-4642-a8f8-f3433a2f94c3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:15.398690 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-89dc369b-f1d4-4642-a8f8-f3433a2f94c3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:15.407333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-89dc369b-f1d4-4642-a8f8-f3433a2f94c3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1136 microversion: 2.1 time: 0.088176 Oct 24 13:40:15.407903 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 629/1254] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:15 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1136 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:15.812504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-77ab9a72-a351-4078-900b-50c40f9b912a req-f7042e2f-0909-4143-8256-7a9944a3318b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50390c66-fb8d-4e03-96b9-7dfdc674d94b", "name": "network-vif-plugged", "status": "completed", "tag": "a803f95f-7afc-42f9-a263-976a6ba10f8f"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:40:15.813329 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-12825408-8af4-4e05-9c1e-e2897f9401b4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:15.813945 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-12825408-8af4-4e05-9c1e-e2897f9401b4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:15.818251 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:40:15.820443 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-12825408-8af4-4e05-9c1e-e2897f9401b4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:15.823851 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-12825408-8af4-4e05-9c1e-e2897f9401b4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:15.823851 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-12825408-8af4-4e05-9c1e-e2897f9401b4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:15.823851 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-12825408-8af4-4e05-9c1e-e2897f9401b4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:15.823851 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-12825408-8af4-4e05-9c1e-e2897f9401b4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:15.824435 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-12825408-8af4-4e05-9c1e-e2897f9401b4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:15.824535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-77ab9a72-a351-4078-900b-50c40f9b912a req-f7042e2f-0909-4143-8256-7a9944a3318b service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:15.824535 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-77ab9a72-a351-4078-900b-50c40f9b912a req-f7042e2f-0909-4143-8256-7a9944a3318b service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:15.824745 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-77ab9a72-a351-4078-900b-50c40f9b912a req-f7042e2f-0909-4143-8256-7a9944a3318b service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:15.828784 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=95 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:40:15.835894 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-77ab9a72-a351-4078-900b-50c40f9b912a req-f7042e2f-0909-4143-8256-7a9944a3318b service nova] Creating event network-vif-plugged:a803f95f-7afc-42f9-a263-976a6ba10f8f for instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b on hv-cinder-86249 Oct 24 13:40:15.840846 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-77ab9a72-a351-4078-900b-50c40f9b912a req-f7042e2f-0909-4143-8256-7a9944a3318b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032665 Oct 24 13:40:15.841439 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 626/1255] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:40:15.961567 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-12825408-8af4-4e05-9c1e-e2897f9401b4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:15.969505 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-12825408-8af4-4e05-9c1e-e2897f9401b4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 200 len: 1365 microversion: 2.1 time: 0.161004 Oct 24 13:40:15.970063 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 630/1256] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:15 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:40:16.436591 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-6df00a9d-5c28-4870-a420-b5a1010dca9d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:16.437291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-6df00a9d-5c28-4870-a420-b5a1010dca9d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:16.443993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6df00a9d-5c28-4870-a420-b5a1010dca9d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:16.444505 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6df00a9d-5c28-4870-a420-b5a1010dca9d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:16.444938 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6df00a9d-5c28-4870-a420-b5a1010dca9d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:16.445629 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6df00a9d-5c28-4870-a420-b5a1010dca9d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:16.446080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6df00a9d-5c28-4870-a420-b5a1010dca9d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:16.446498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-6df00a9d-5c28-4870-a420-b5a1010dca9d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:16.663018 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-6df00a9d-5c28-4870-a420-b5a1010dca9d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:16.670679 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-6df00a9d-5c28-4870-a420-b5a1010dca9d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1210 microversion: 2.1 time: 0.239044 Oct 24 13:40:16.671250 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 627/1257] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:16 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1210 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:16.993173 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-7c926313-4eb2-4fb3-b887-98451933cd2d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:16.993775 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-7c926313-4eb2-4fb3-b887-98451933cd2d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:17.001176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7c926313-4eb2-4fb3-b887-98451933cd2d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:17.001670 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7c926313-4eb2-4fb3-b887-98451933cd2d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:17.002153 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7c926313-4eb2-4fb3-b887-98451933cd2d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:17.002840 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7c926313-4eb2-4fb3-b887-98451933cd2d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:17.003289 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7c926313-4eb2-4fb3-b887-98451933cd2d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:17.003706 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-7c926313-4eb2-4fb3-b887-98451933cd2d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:17.206798 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-7c926313-4eb2-4fb3-b887-98451933cd2d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:17.214594 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-7c926313-4eb2-4fb3-b887-98451933cd2d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 200 len: 1365 microversion: 2.1 time: 0.225796 Oct 24 13:40:17.215178 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 631/1258] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:16 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:17.693548 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-fa906b8f-6ff8-4d04-a4cc-55af34a9acb2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:17.694176 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-fa906b8f-6ff8-4d04-a4cc-55af34a9acb2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:17.700851 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fa906b8f-6ff8-4d04-a4cc-55af34a9acb2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:17.701336 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fa906b8f-6ff8-4d04-a4cc-55af34a9acb2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:17.702417 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fa906b8f-6ff8-4d04-a4cc-55af34a9acb2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:17.703108 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fa906b8f-6ff8-4d04-a4cc-55af34a9acb2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:17.703564 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fa906b8f-6ff8-4d04-a4cc-55af34a9acb2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:17.703988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fa906b8f-6ff8-4d04-a4cc-55af34a9acb2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:17.832635 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fa906b8f-6ff8-4d04-a4cc-55af34a9acb2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:17.840159 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-fa906b8f-6ff8-4d04-a4cc-55af34a9acb2 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1276 microversion: 2.1 time: 0.150450 Oct 24 13:40:17.840761 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 628/1259] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:17 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1276 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:18.239741 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e76fd653-2f87-43fe-b127-078f79dd919e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:18.240406 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e76fd653-2f87-43fe-b127-078f79dd919e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:18.246823 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e76fd653-2f87-43fe-b127-078f79dd919e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:18.248068 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e76fd653-2f87-43fe-b127-078f79dd919e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:18.248068 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e76fd653-2f87-43fe-b127-078f79dd919e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:18.248488 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e76fd653-2f87-43fe-b127-078f79dd919e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:18.249528 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e76fd653-2f87-43fe-b127-078f79dd919e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:18.249942 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e76fd653-2f87-43fe-b127-078f79dd919e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:18.384386 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e76fd653-2f87-43fe-b127-078f79dd919e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:18.392157 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e76fd653-2f87-43fe-b127-078f79dd919e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 200 len: 1554 microversion: 2.1 time: 0.156440 Oct 24 13:40:18.392754 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 632/1260] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:18 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:18.414463 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9574c907-54ed-4c3f-8073-a0fbc8c6bad6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:18.416117 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-9574c907-54ed-4c3f-8073-a0fbc8c6bad6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:18.421392 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9574c907-54ed-4c3f-8073-a0fbc8c6bad6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:18.421870 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9574c907-54ed-4c3f-8073-a0fbc8c6bad6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:18.422302 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9574c907-54ed-4c3f-8073-a0fbc8c6bad6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:18.422995 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9574c907-54ed-4c3f-8073-a0fbc8c6bad6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:18.423443 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9574c907-54ed-4c3f-8073-a0fbc8c6bad6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:18.423862 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9574c907-54ed-4c3f-8073-a0fbc8c6bad6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:18.503679 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9574c907-54ed-4c3f-8073-a0fbc8c6bad6 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092965 Oct 24 13:40:18.504422 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 629/1261] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 24 13:40:18 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:40:18.862985 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e418a96a-ab7f-48e3-bb57-f58ef6b9a6f3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:18.863969 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e418a96a-ab7f-48e3-bb57-f58ef6b9a6f3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:18.870962 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e418a96a-ab7f-48e3-bb57-f58ef6b9a6f3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:18.871720 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e418a96a-ab7f-48e3-bb57-f58ef6b9a6f3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:18.872418 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e418a96a-ab7f-48e3-bb57-f58ef6b9a6f3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:18.873268 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e418a96a-ab7f-48e3-bb57-f58ef6b9a6f3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:18.873720 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e418a96a-ab7f-48e3-bb57-f58ef6b9a6f3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:18.874416 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e418a96a-ab7f-48e3-bb57-f58ef6b9a6f3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:19.033114 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-e418a96a-ab7f-48e3-bb57-f58ef6b9a6f3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:19.041909 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-45f0783a-a41d-4996-bbe8-260a755d9216 req-9d320289-7161-457a-99f8-6aeb418d0ddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42bdff1e-48cd-4c08-a043-0e592c6d119c", "tag": "e309bad0-13db-408d-9058-da5aa46fcee8"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:40:19.042811 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e418a96a-ab7f-48e3-bb57-f58ef6b9a6f3 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1264 microversion: 2.1 time: 0.184499 Oct 24 13:40:19.043758 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 633/1262] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:18 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:19.062436 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-45f0783a-a41d-4996-bbe8-260a755d9216 req-9d320289-7161-457a-99f8-6aeb418d0ddf service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:19.063232 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-45f0783a-a41d-4996-bbe8-260a755d9216 req-9d320289-7161-457a-99f8-6aeb418d0ddf service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:19.063656 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-45f0783a-a41d-4996-bbe8-260a755d9216 req-9d320289-7161-457a-99f8-6aeb418d0ddf service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:19.078060 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-45f0783a-a41d-4996-bbe8-260a755d9216 req-9d320289-7161-457a-99f8-6aeb418d0ddf service nova] Creating event network-changed:e309bad0-13db-408d-9058-da5aa46fcee8 for instance 42bdff1e-48cd-4c08-a043-0e592c6d119c on hv-cinder-86249 Oct 24 13:40:19.084010 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-45f0783a-a41d-4996-bbe8-260a755d9216 req-9d320289-7161-457a-99f8-6aeb418d0ddf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047346 Oct 24 13:40:19.084634 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 630/1263] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:40:19.503052 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-b17e6d68-470e-42fc-879e-4b6bbad8628f req-a25cf977-83f8-48a3-aae9-3e7177861e4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50390c66-fb8d-4e03-96b9-7dfdc674d94b", "tag": "a803f95f-7afc-42f9-a263-976a6ba10f8f"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:40:19.513455 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-b17e6d68-470e-42fc-879e-4b6bbad8628f req-a25cf977-83f8-48a3-aae9-3e7177861e4c service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:19.514081 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-b17e6d68-470e-42fc-879e-4b6bbad8628f req-a25cf977-83f8-48a3-aae9-3e7177861e4c service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:19.515308 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-b17e6d68-470e-42fc-879e-4b6bbad8628f req-a25cf977-83f8-48a3-aae9-3e7177861e4c service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:19.526775 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-b17e6d68-470e-42fc-879e-4b6bbad8628f req-a25cf977-83f8-48a3-aae9-3e7177861e4c service nova] Creating event network-changed:a803f95f-7afc-42f9-a263-976a6ba10f8f for instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b on hv-cinder-86249 Oct 24 13:40:19.531962 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-b17e6d68-470e-42fc-879e-4b6bbad8628f req-a25cf977-83f8-48a3-aae9-3e7177861e4c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033514 Oct 24 13:40:19.532637 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 634/1264] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:40:20.069670 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-692af086-aa0e-4781-8f26-65358da4f62b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:20.070278 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-692af086-aa0e-4781-8f26-65358da4f62b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:20.077974 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-692af086-aa0e-4781-8f26-65358da4f62b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:20.078451 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-692af086-aa0e-4781-8f26-65358da4f62b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:20.079037 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-692af086-aa0e-4781-8f26-65358da4f62b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:20.079889 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-692af086-aa0e-4781-8f26-65358da4f62b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:20.080518 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-692af086-aa0e-4781-8f26-65358da4f62b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:20.081094 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-692af086-aa0e-4781-8f26-65358da4f62b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:20.221507 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-692af086-aa0e-4781-8f26-65358da4f62b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:20.229398 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-692af086-aa0e-4781-8f26-65358da4f62b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1264 microversion: 2.1 time: 0.164716 Oct 24 13:40:20.229974 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 631/1265] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:20 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:21.254402 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-957a8be8-0e54-47ca-afc6-6931efe92d4d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:21.255099 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-957a8be8-0e54-47ca-afc6-6931efe92d4d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:21.261210 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-957a8be8-0e54-47ca-afc6-6931efe92d4d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:21.261679 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-957a8be8-0e54-47ca-afc6-6931efe92d4d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:21.262107 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-957a8be8-0e54-47ca-afc6-6931efe92d4d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:21.262781 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-957a8be8-0e54-47ca-afc6-6931efe92d4d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:21.263229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-957a8be8-0e54-47ca-afc6-6931efe92d4d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:21.263644 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-957a8be8-0e54-47ca-afc6-6931efe92d4d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:21.450277 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-957a8be8-0e54-47ca-afc6-6931efe92d4d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:21.458011 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-957a8be8-0e54-47ca-afc6-6931efe92d4d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1264 microversion: 2.1 time: 0.208335 Oct 24 13:40:21.458574 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 635/1266] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:21 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1264 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:22.480547 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-2aa7d664-b70c-44a7-9ae3-8b1f2863777f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:22.485813 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-2aa7d664-b70c-44a7-9ae3-8b1f2863777f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:22.487736 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2aa7d664-b70c-44a7-9ae3-8b1f2863777f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:22.488211 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2aa7d664-b70c-44a7-9ae3-8b1f2863777f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:22.488714 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2aa7d664-b70c-44a7-9ae3-8b1f2863777f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:22.489393 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2aa7d664-b70c-44a7-9ae3-8b1f2863777f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:22.489841 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2aa7d664-b70c-44a7-9ae3-8b1f2863777f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:22.490255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2aa7d664-b70c-44a7-9ae3-8b1f2863777f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:22.617804 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-2aa7d664-b70c-44a7-9ae3-8b1f2863777f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:22.626035 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-2aa7d664-b70c-44a7-9ae3-8b1f2863777f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1264 microversion: 2.1 time: 0.149672 Oct 24 13:40:22.626600 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 632/1267] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:22 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:23.648828 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ba9bf05a-cdd7-44ef-a70f-fda9e3a32a81 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:23.649439 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ba9bf05a-cdd7-44ef-a70f-fda9e3a32a81 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:23.656025 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba9bf05a-cdd7-44ef-a70f-fda9e3a32a81 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:23.656529 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba9bf05a-cdd7-44ef-a70f-fda9e3a32a81 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:23.656965 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba9bf05a-cdd7-44ef-a70f-fda9e3a32a81 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:23.657648 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba9bf05a-cdd7-44ef-a70f-fda9e3a32a81 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:23.658096 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba9bf05a-cdd7-44ef-a70f-fda9e3a32a81 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:23.658513 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ba9bf05a-cdd7-44ef-a70f-fda9e3a32a81 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:23.786255 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ba9bf05a-cdd7-44ef-a70f-fda9e3a32a81 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:23.793797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ba9bf05a-cdd7-44ef-a70f-fda9e3a32a81 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1264 microversion: 2.1 time: 0.148812 Oct 24 13:40:23.794375 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 636/1268] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:23 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:24.817795 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-20a0674c-4eb3-4d94-a530-3547e4f5cde0 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:24.818406 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-20a0674c-4eb3-4d94-a530-3547e4f5cde0 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:24.820545 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=2 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:40:24.821198 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=6 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:40:24.826111 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-20a0674c-4eb3-4d94-a530-3547e4f5cde0 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:24.826585 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-20a0674c-4eb3-4d94-a530-3547e4f5cde0 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:24.827012 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-20a0674c-4eb3-4d94-a530-3547e4f5cde0 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:24.827690 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-20a0674c-4eb3-4d94-a530-3547e4f5cde0 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:24.828134 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-20a0674c-4eb3-4d94-a530-3547e4f5cde0 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:24.828575 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-20a0674c-4eb3-4d94-a530-3547e4f5cde0 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:24.957396 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-20a0674c-4eb3-4d94-a530-3547e4f5cde0 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:24.965080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-20a0674c-4eb3-4d94-a530-3547e4f5cde0 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1264 microversion: 2.1 time: 0.151154 Oct 24 13:40:24.965640 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 633/1269] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:24 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:25.988616 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9be28854-67da-4667-9b08-393ef50dcd38 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:25.989204 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9be28854-67da-4667-9b08-393ef50dcd38 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:25.991196 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=2 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:40:25.996346 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9be28854-67da-4667-9b08-393ef50dcd38 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:25.996815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9be28854-67da-4667-9b08-393ef50dcd38 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:25.997238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9be28854-67da-4667-9b08-393ef50dcd38 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:25.997909 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9be28854-67da-4667-9b08-393ef50dcd38 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:25.998346 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9be28854-67da-4667-9b08-393ef50dcd38 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:25.999343 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9be28854-67da-4667-9b08-393ef50dcd38 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:26.133681 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9be28854-67da-4667-9b08-393ef50dcd38 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:26.141976 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9be28854-67da-4667-9b08-393ef50dcd38 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1264 microversion: 2.1 time: 0.157170 Oct 24 13:40:26.142534 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 637/1270] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:25 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:27.164377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bae3abc6-89b6-487c-8b33-b2bcb9573b11 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:27.165020 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bae3abc6-89b6-487c-8b33-b2bcb9573b11 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:27.171907 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bae3abc6-89b6-487c-8b33-b2bcb9573b11 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:27.172414 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bae3abc6-89b6-487c-8b33-b2bcb9573b11 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:27.172847 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bae3abc6-89b6-487c-8b33-b2bcb9573b11 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:27.173550 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bae3abc6-89b6-487c-8b33-b2bcb9573b11 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:27.173999 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bae3abc6-89b6-487c-8b33-b2bcb9573b11 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:27.174417 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bae3abc6-89b6-487c-8b33-b2bcb9573b11 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:27.304131 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-bae3abc6-89b6-487c-8b33-b2bcb9573b11 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:27.312507 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-bae3abc6-89b6-487c-8b33-b2bcb9573b11 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1264 microversion: 2.1 time: 0.151993 Oct 24 13:40:27.313085 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 634/1271] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:27 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:28.335093 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-fbfc7d94-7de4-478e-810d-46408a6de0d8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:28.335789 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-fbfc7d94-7de4-478e-810d-46408a6de0d8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:28.342874 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fbfc7d94-7de4-478e-810d-46408a6de0d8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:28.343347 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fbfc7d94-7de4-478e-810d-46408a6de0d8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:28.343771 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fbfc7d94-7de4-478e-810d-46408a6de0d8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:28.344538 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fbfc7d94-7de4-478e-810d-46408a6de0d8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:28.344928 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fbfc7d94-7de4-478e-810d-46408a6de0d8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:28.345348 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fbfc7d94-7de4-478e-810d-46408a6de0d8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:28.474306 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-fbfc7d94-7de4-478e-810d-46408a6de0d8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:28.482081 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-fbfc7d94-7de4-478e-810d-46408a6de0d8 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1264 microversion: 2.1 time: 0.151077 Oct 24 13:40:28.482651 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 638/1272] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:28 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:29.505295 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9897138f-c82e-4137-a0fb-b3575bc6d20b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:29.505915 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-9897138f-c82e-4137-a0fb-b3575bc6d20b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:29.512390 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9897138f-c82e-4137-a0fb-b3575bc6d20b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:29.512875 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9897138f-c82e-4137-a0fb-b3575bc6d20b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:29.513309 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9897138f-c82e-4137-a0fb-b3575bc6d20b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:29.513993 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9897138f-c82e-4137-a0fb-b3575bc6d20b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:29.514953 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9897138f-c82e-4137-a0fb-b3575bc6d20b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:29.515372 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9897138f-c82e-4137-a0fb-b3575bc6d20b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:29.645718 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-9897138f-c82e-4137-a0fb-b3575bc6d20b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:29.653630 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9897138f-c82e-4137-a0fb-b3575bc6d20b tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1264 microversion: 2.1 time: 0.152217 Oct 24 13:40:29.654258 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 635/1273] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:29 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:29.794383 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-8427bb69-9954-482f-bb0c-2ebcd6b8e430 req-408fb998-5398-4eff-b3d6-a69848584a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42bdff1e-48cd-4c08-a043-0e592c6d119c", "name": "network-vif-plugged", "status": "completed", "tag": "e309bad0-13db-408d-9058-da5aa46fcee8"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:40:29.804087 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-8427bb69-9954-482f-bb0c-2ebcd6b8e430 req-408fb998-5398-4eff-b3d6-a69848584a66 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:29.804707 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-8427bb69-9954-482f-bb0c-2ebcd6b8e430 req-408fb998-5398-4eff-b3d6-a69848584a66 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:29.805128 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-8427bb69-9954-482f-bb0c-2ebcd6b8e430 req-408fb998-5398-4eff-b3d6-a69848584a66 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:29.816854 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-8427bb69-9954-482f-bb0c-2ebcd6b8e430 req-408fb998-5398-4eff-b3d6-a69848584a66 service nova] Creating event network-vif-plugged:e309bad0-13db-408d-9058-da5aa46fcee8 for instance 42bdff1e-48cd-4c08-a043-0e592c6d119c on hv-cinder-86249 Oct 24 13:40:29.822113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-8427bb69-9954-482f-bb0c-2ebcd6b8e430 req-408fb998-5398-4eff-b3d6-a69848584a66 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031691 Oct 24 13:40:29.822697 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 639/1274] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:40:30.677199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5de7d118-90a3-453e-a896-e210485259b0 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:30.677861 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5de7d118-90a3-453e-a896-e210485259b0 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:30.684296 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5de7d118-90a3-453e-a896-e210485259b0 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:30.684773 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5de7d118-90a3-453e-a896-e210485259b0 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:30.685203 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5de7d118-90a3-453e-a896-e210485259b0 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:30.685890 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5de7d118-90a3-453e-a896-e210485259b0 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:30.686850 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5de7d118-90a3-453e-a896-e210485259b0 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:30.687271 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5de7d118-90a3-453e-a896-e210485259b0 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:30.821341 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5de7d118-90a3-453e-a896-e210485259b0 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:30.829421 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5de7d118-90a3-453e-a896-e210485259b0 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1264 microversion: 2.1 time: 0.156224 Oct 24 13:40:30.830078 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 636/1275] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:30 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:31.852576 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-54e16ff9-9abe-43db-817c-2953c752e3d7 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:31.853273 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-54e16ff9-9abe-43db-817c-2953c752e3d7 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:31.859845 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-54e16ff9-9abe-43db-817c-2953c752e3d7 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:31.860334 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-54e16ff9-9abe-43db-817c-2953c752e3d7 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:31.860765 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-54e16ff9-9abe-43db-817c-2953c752e3d7 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:31.861442 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-54e16ff9-9abe-43db-817c-2953c752e3d7 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:31.861889 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-54e16ff9-9abe-43db-817c-2953c752e3d7 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:31.862308 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-54e16ff9-9abe-43db-817c-2953c752e3d7 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:32.022023 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-54e16ff9-9abe-43db-817c-2953c752e3d7 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:32.034241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-54e16ff9-9abe-43db-817c-2953c752e3d7 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1264 microversion: 2.1 time: 0.186118 Oct 24 13:40:32.035196 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 640/1276] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:31 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:33.058165 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-98062613-7362-4569-a473-2fa8847a3b21 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:33.058783 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-98062613-7362-4569-a473-2fa8847a3b21 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:33.065725 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-98062613-7362-4569-a473-2fa8847a3b21 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:33.066200 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-98062613-7362-4569-a473-2fa8847a3b21 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:33.066627 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-98062613-7362-4569-a473-2fa8847a3b21 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:33.067310 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-98062613-7362-4569-a473-2fa8847a3b21 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:33.067760 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-98062613-7362-4569-a473-2fa8847a3b21 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:33.068175 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-98062613-7362-4569-a473-2fa8847a3b21 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:33.199079 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-98062613-7362-4569-a473-2fa8847a3b21 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:33.206708 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-98062613-7362-4569-a473-2fa8847a3b21 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1450 microversion: 2.1 time: 0.152527 Oct 24 13:40:33.207266 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 637/1277] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:33 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:33.228628 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-1c0a6020-170a-48b0-9d73-3902c4ae0c94 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:33.229236 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-1c0a6020-170a-48b0-9d73-3902c4ae0c94 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:40:33.236138 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1c0a6020-170a-48b0-9d73-3902c4ae0c94 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:33.236673 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1c0a6020-170a-48b0-9d73-3902c4ae0c94 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:33.237100 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1c0a6020-170a-48b0-9d73-3902c4ae0c94 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:33.237778 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1c0a6020-170a-48b0-9d73-3902c4ae0c94 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:33.238225 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1c0a6020-170a-48b0-9d73-3902c4ae0c94 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:33.238644 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1c0a6020-170a-48b0-9d73-3902c4ae0c94 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:33.365871 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-1c0a6020-170a-48b0-9d73-3902c4ae0c94 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:40:33.374360 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-1c0a6020-170a-48b0-9d73-3902c4ae0c94 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1450 microversion: 2.1 time: 0.148889 Oct 24 13:40:33.374929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 641/1278] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:40:33 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:40:35.956084 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-dfe49e47-a2cb-43b5-89be-59626a3bba12 req-34fb8d58-ea84-41fa-b68c-e63a0c9fa288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42bdff1e-48cd-4c08-a043-0e592c6d119c", "tag": "e309bad0-13db-408d-9058-da5aa46fcee8"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:40:35.966611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-dfe49e47-a2cb-43b5-89be-59626a3bba12 req-34fb8d58-ea84-41fa-b68c-e63a0c9fa288 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:35.967093 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-dfe49e47-a2cb-43b5-89be-59626a3bba12 req-34fb8d58-ea84-41fa-b68c-e63a0c9fa288 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:35.967577 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-dfe49e47-a2cb-43b5-89be-59626a3bba12 req-34fb8d58-ea84-41fa-b68c-e63a0c9fa288 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:35.979051 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-dfe49e47-a2cb-43b5-89be-59626a3bba12 req-34fb8d58-ea84-41fa-b68c-e63a0c9fa288 service nova] Creating event network-changed:e309bad0-13db-408d-9058-da5aa46fcee8 for instance 42bdff1e-48cd-4c08-a043-0e592c6d119c on hv-cinder-86249 Oct 24 13:40:35.984494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-dfe49e47-a2cb-43b5-89be-59626a3bba12 req-34fb8d58-ea84-41fa-b68c-e63a0c9fa288 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032520 Oct 24 13:40:35.985133 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 638/1279] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:34.589163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=25 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:41:34.589924 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=78 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:41:34.591216 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 13:41:34.591365 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Mon Oct 24 13:41:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b/ips (ip 10.222.0.48) !!! Oct 24 13:41:34.649652 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6ebf3ce6-6bc6-473e-b350-f55ba1dbb1a1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:34.650139 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-6ebf3ce6-6bc6-473e-b350-f55ba1dbb1a1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:41:34.656006 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ebf3ce6-6bc6-473e-b350-f55ba1dbb1a1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:34.656538 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ebf3ce6-6bc6-473e-b350-f55ba1dbb1a1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:34.656958 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ebf3ce6-6bc6-473e-b350-f55ba1dbb1a1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:34.657624 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ebf3ce6-6bc6-473e-b350-f55ba1dbb1a1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:34.658063 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ebf3ce6-6bc6-473e-b350-f55ba1dbb1a1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:34.658470 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6ebf3ce6-6bc6-473e-b350-f55ba1dbb1a1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:34.681895 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6ebf3ce6-6bc6-473e-b350-f55ba1dbb1a1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b/ips" status: 200 len: 149 microversion: 2.1 time: 0.094696 Oct 24 13:41:34.682435 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 642/1280] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 24 13:41:34 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b/ips => generated 149 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:37.292675 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=25 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:41:37.293445 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=63 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:41:37.298151 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-131166a8-2495-4abe-b224-663101d1ab88 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8402861-5633-4cb5-80d4-c73bfa7c7cd2"}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:41:37.301313 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-131166a8-2495-4abe-b224-663101d1ab88 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:41:37.307494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-131166a8-2495-4abe-b224-663101d1ab88 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:37.307974 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-131166a8-2495-4abe-b224-663101d1ab88 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:37.308438 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-131166a8-2495-4abe-b224-663101d1ab88 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:37.309124 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-131166a8-2495-4abe-b224-663101d1ab88 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:37.309573 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-131166a8-2495-4abe-b224-663101d1ab88 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:37.310072 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-131166a8-2495-4abe-b224-663101d1ab88 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:38.070172 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-131166a8-2495-4abe-b224-663101d1ab88 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "POST /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.779210 Oct 24 13:41:38.071074 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 639/1281] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 24 13:41:37 2022] POST /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b/os-volume_attachments => generated 194 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:45.597684 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8b4d310e-59c5-4a10-8d62-1ac8b9f43e29 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8402861-5633-4cb5-80d4-c73bfa7c7cd2"}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:41:45.600154 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-8b4d310e-59c5-4a10-8d62-1ac8b9f43e29 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:41:45.602758 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=2 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:41:45.603448 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=4 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:41:45.608246 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8b4d310e-59c5-4a10-8d62-1ac8b9f43e29 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:45.608692 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8b4d310e-59c5-4a10-8d62-1ac8b9f43e29 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:45.609115 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8b4d310e-59c5-4a10-8d62-1ac8b9f43e29 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:45.609800 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8b4d310e-59c5-4a10-8d62-1ac8b9f43e29 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:45.610246 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8b4d310e-59c5-4a10-8d62-1ac8b9f43e29 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:45.610658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-8b4d310e-59c5-4a10-8d62-1ac8b9f43e29 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:45.691496 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-8b4d310e-59c5-4a10-8d62-1ac8b9f43e29 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] HTTP exception thrown: Invalid volume: volume c8402861-5633-4cb5-80d4-c73bfa7c7cd2 is already attached to instances: 50390c66-fb8d-4e03-96b9-7dfdc674d94b Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8b4d310e-59c5-4a10-8d62-1ac8b9f43e29 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Request method failure captured: Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: POST /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b/os-volume_attachments HTTP/1.1 Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 74 Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpTbRRXQSAKwonVGeChkQxnwDI7hnY-9OBoe_qnbtdeMF_9XlbOZKw0JbfEXuhVi4scmDs_GUKvJoTXwlczS-zmtlXzqna6piOiITjfrb2p2E7hfxVXwAjE0Dt7XmIWSB362Q5Fsw_cewEhIEFbVblBQ6zgqJNdaeZDZqts2BcPdRJc Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:41:45.694083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:41:45.696320 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0a7896472f034eb4b3b028d528cfbac0"}]}] Oct 24 13:41:45.696320 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:41:45.696320 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:41:45.696320 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:41:45.696320 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:41:45.696320 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:41:45.696320 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:41:45.696320 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 54fcced6d8d943608b940d1dab001540 Oct 24 13:41:45.696320 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:41:45.696320 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Oct 24 13:41:45.696320 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {"volumeAttachment": {"volumeId": "c8402861-5633-4cb5-80d4-c73bfa7c7cd2"}} Oct 24 13:41:45.696320 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:41:45.697227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Invalid volume: volume c8402861-5633-4cb5-80d4-c73bfa7c7cd2 is already attached to instances: 50390c66-fb8d-4e03-96b9-7dfdc674d94b Oct 24 13:41:45.697227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'server_id': '50390c66-fb8d-4e03-96b9-7dfdc674d94b', 'body': {'volumeAttachment': {'volumeId': 'c8402861-5633-4cb5-80d4-c73bfa7c7cd2'}}} Oct 24 13:41:45.697227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:41:45.697227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:45.697227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 24 13:41:45.697227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 24 13:41:45.697227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 13:41:45.697227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 13:41:45.697227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 24 13:41:45.697227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 13:41:45.697227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 24 13:41:45.697227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 24 13:41:45.697227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 24 13:41:45.697227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 24 13:41:45.697227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c8402861-5633-4cb5-80d4-c73bfa7c7cd2 is already attached to instances: 50390c66-fb8d-4e03-96b9-7dfdc674d94b Oct 24 13:41:45.697227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:41:45.697227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:41:45.697227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:41:45.697227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:45.698585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:41:45.698585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:41:45.698585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:41:45.698585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:41:45.698585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:41:45.698585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:41:45.698585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:41:45.698585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:41:45.698585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:41:45.698585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:41:45.698585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:41:45.698585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:41:45.698585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 24 13:41:45.698585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 24 13:41:45.698585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c8402861-5633-4cb5-80d4-c73bfa7c7cd2 is already attached to instances: 50390c66-fb8d-4e03-96b9-7dfdc674d94b Oct 24 13:41:45.698585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:41:45.698585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:41:45.698585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:41:45.698585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:45.698585 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:41:45.700424 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:41:45.700424 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:41:45.700424 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:41:45.700424 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c8402861-5633-4cb5-80d4-c73bfa7c7cd2 is already attached to instances: 50390c66-fb8d-4e03-96b9-7dfdc674d94b Oct 24 13:41:45.700424 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:41:45.700424 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-8b4d310e-59c5-4a10-8d62-1ac8b9f43e29 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Returning 400 to user: Invalid volume: volume c8402861-5633-4cb5-80d4-c73bfa7c7cd2 is already attached to instances: 50390c66-fb8d-4e03-96b9-7dfdc674d94b {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:41:45.700424 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-8b4d310e-59c5-4a10-8d62-1ac8b9f43e29 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "POST /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102670 Oct 24 13:41:45.700424 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 643/1282] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 24 13:41:45 2022] POST /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:41:45.763483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bbda9a8b-c138-49a2-8b7e-db84b02b2e64 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:45.764058 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bbda9a8b-c138-49a2-8b7e-db84b02b2e64 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:41:45.770724 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bbda9a8b-c138-49a2-8b7e-db84b02b2e64 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:45.771196 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bbda9a8b-c138-49a2-8b7e-db84b02b2e64 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:45.771622 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bbda9a8b-c138-49a2-8b7e-db84b02b2e64 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:45.772326 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bbda9a8b-c138-49a2-8b7e-db84b02b2e64 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:45.772770 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bbda9a8b-c138-49a2-8b7e-db84b02b2e64 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:45.773186 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bbda9a8b-c138-49a2-8b7e-db84b02b2e64 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:45.851207 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.objects.instance [None req-bbda9a8b-c138-49a2-8b7e-db84b02b2e64 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lazy-loading 'services' on Instance uuid 50390c66-fb8d-4e03-96b9-7dfdc674d94b {{(pid=119146) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:41:46.008031 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-bbda9a8b-c138-49a2-8b7e-db84b02b2e64 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "DELETE /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b/os-volume_attachments/c8402861-5633-4cb5-80d4-c73bfa7c7cd2" status: 202 len: 0 microversion: 2.1 time: 0.248746 Oct 24 13:41:46.008716 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 640/1283] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 24 13:41:45 2022] DELETE /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b/os-volume_attachments/c8402861-5633-4cb5-80d4-c73bfa7c7cd2 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:41:46.017031 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9672a573-4cd4-4f24-b097-75f61071e193 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:46.019185 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9672a573-4cd4-4f24-b097-75f61071e193 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:41:46.028850 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9672a573-4cd4-4f24-b097-75f61071e193 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:46.032467 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9672a573-4cd4-4f24-b097-75f61071e193 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:46.032467 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9672a573-4cd4-4f24-b097-75f61071e193 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:46.032467 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9672a573-4cd4-4f24-b097-75f61071e193 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:46.032467 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9672a573-4cd4-4f24-b097-75f61071e193 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:46.032917 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9672a573-4cd4-4f24-b097-75f61071e193 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:46.061102 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9672a573-4cd4-4f24-b097-75f61071e193 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048133 Oct 24 13:41:46.061663 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 644/1284] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 24 13:41:46 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:47.074983 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-2fe1c209-1a71-412c-a692-a9ddf2051615 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:47.077512 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-2fe1c209-1a71-412c-a692-a9ddf2051615 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:41:47.084422 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2fe1c209-1a71-412c-a692-a9ddf2051615 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:47.084932 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2fe1c209-1a71-412c-a692-a9ddf2051615 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:47.085358 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2fe1c209-1a71-412c-a692-a9ddf2051615 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:47.086049 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2fe1c209-1a71-412c-a692-a9ddf2051615 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:47.086491 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2fe1c209-1a71-412c-a692-a9ddf2051615 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:47.086935 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-2fe1c209-1a71-412c-a692-a9ddf2051615 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:47.117459 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-2fe1c209-1a71-412c-a692-a9ddf2051615 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047511 Oct 24 13:41:47.118015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 641/1285] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 24 13:41:47 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:48.128965 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b8f10569-00f7-4d38-a24e-fef6a49c4e4b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:48.131653 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b8f10569-00f7-4d38-a24e-fef6a49c4e4b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:41:48.137999 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b8f10569-00f7-4d38-a24e-fef6a49c4e4b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:48.138467 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b8f10569-00f7-4d38-a24e-fef6a49c4e4b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:48.138887 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b8f10569-00f7-4d38-a24e-fef6a49c4e4b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:48.139552 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b8f10569-00f7-4d38-a24e-fef6a49c4e4b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:48.139990 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b8f10569-00f7-4d38-a24e-fef6a49c4e4b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:48.140552 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b8f10569-00f7-4d38-a24e-fef6a49c4e4b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:48.167885 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b8f10569-00f7-4d38-a24e-fef6a49c4e4b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042953 Oct 24 13:41:48.168478 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 645/1286] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 24 13:41:48 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:41:48.230490 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-ae296568-6c8a-44bc-a4fd-07cc85fc0a0d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:48.230970 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-ae296568-6c8a-44bc-a4fd-07cc85fc0a0d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:41:48.237390 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ae296568-6c8a-44bc-a4fd-07cc85fc0a0d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:48.237862 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ae296568-6c8a-44bc-a4fd-07cc85fc0a0d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:48.238298 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ae296568-6c8a-44bc-a4fd-07cc85fc0a0d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:48.239585 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ae296568-6c8a-44bc-a4fd-07cc85fc0a0d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:48.240035 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ae296568-6c8a-44bc-a4fd-07cc85fc0a0d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:48.240498 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-ae296568-6c8a-44bc-a4fd-07cc85fc0a0d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:48.264580 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-ae296568-6c8a-44bc-a4fd-07cc85fc0a0d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Going to try to terminate instance {{(pid=119146) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:41:48.477717 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-ae296568-6c8a-44bc-a4fd-07cc85fc0a0d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "DELETE /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 204 len: 0 microversion: 2.1 time: 0.250735 Oct 24 13:41:48.478470 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 642/1287] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:41:48 2022] DELETE /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:41:48.486670 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-81bcc5c5-6a90-48a0-b623-1f50443b6614 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:48.487276 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-81bcc5c5-6a90-48a0-b623-1f50443b6614 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:41:48.493854 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81bcc5c5-6a90-48a0-b623-1f50443b6614 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:48.494317 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81bcc5c5-6a90-48a0-b623-1f50443b6614 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:48.494738 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81bcc5c5-6a90-48a0-b623-1f50443b6614 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:48.495413 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81bcc5c5-6a90-48a0-b623-1f50443b6614 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:48.495850 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81bcc5c5-6a90-48a0-b623-1f50443b6614 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:48.496261 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-81bcc5c5-6a90-48a0-b623-1f50443b6614 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:48.623566 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-81bcc5c5-6a90-48a0-b623-1f50443b6614 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:41:48.631391 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-81bcc5c5-6a90-48a0-b623-1f50443b6614 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 200 len: 1679 microversion: 2.1 time: 0.148624 Oct 24 13:41:48.631966 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 646/1288] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:41:48 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:41:49.655075 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-75b3d0e7-bc5a-4820-bfb7-b7904a587eaf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:49.655769 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-75b3d0e7-bc5a-4820-bfb7-b7904a587eaf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:41:49.662705 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-75b3d0e7-bc5a-4820-bfb7-b7904a587eaf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:49.663187 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-75b3d0e7-bc5a-4820-bfb7-b7904a587eaf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:49.663611 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-75b3d0e7-bc5a-4820-bfb7-b7904a587eaf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:49.664314 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-75b3d0e7-bc5a-4820-bfb7-b7904a587eaf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:49.664759 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-75b3d0e7-bc5a-4820-bfb7-b7904a587eaf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:49.665170 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-75b3d0e7-bc5a-4820-bfb7-b7904a587eaf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:49.800669 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-75b3d0e7-bc5a-4820-bfb7-b7904a587eaf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:41:49.809294 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-75b3d0e7-bc5a-4820-bfb7-b7904a587eaf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 200 len: 1679 microversion: 2.1 time: 0.158448 Oct 24 13:41:49.815667 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 643/1289] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:41:49 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:41:50.832802 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9774dc7a-a4c5-4aa7-9ca6-9c4576eb17d8 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:50.833449 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9774dc7a-a4c5-4aa7-9ca6-9c4576eb17d8 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:41:50.839728 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9774dc7a-a4c5-4aa7-9ca6-9c4576eb17d8 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:50.840203 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9774dc7a-a4c5-4aa7-9ca6-9c4576eb17d8 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:50.840673 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9774dc7a-a4c5-4aa7-9ca6-9c4576eb17d8 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:50.841353 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9774dc7a-a4c5-4aa7-9ca6-9c4576eb17d8 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:50.841796 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9774dc7a-a4c5-4aa7-9ca6-9c4576eb17d8 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:50.842212 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9774dc7a-a4c5-4aa7-9ca6-9c4576eb17d8 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:51.037325 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9774dc7a-a4c5-4aa7-9ca6-9c4576eb17d8 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:41:51.045635 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9774dc7a-a4c5-4aa7-9ca6-9c4576eb17d8 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 200 len: 1679 microversion: 2.1 time: 0.216666 Oct 24 13:41:51.046466 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 647/1290] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:41:50 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 1679 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:41:51.536853 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-e9559b74-369d-45b4-942c-ea34d04e0d0c req-27aac946-26d8-4697-8731-375e4dc42436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50390c66-fb8d-4e03-96b9-7dfdc674d94b", "name": "network-vif-deleted", "tag": "a803f95f-7afc-42f9-a263-976a6ba10f8f"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:41:51.549441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-e9559b74-369d-45b4-942c-ea34d04e0d0c req-27aac946-26d8-4697-8731-375e4dc42436 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:51.549910 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-e9559b74-369d-45b4-942c-ea34d04e0d0c req-27aac946-26d8-4697-8731-375e4dc42436 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:51.550534 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-e9559b74-369d-45b4-942c-ea34d04e0d0c req-27aac946-26d8-4697-8731-375e4dc42436 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:51.562939 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-e9559b74-369d-45b4-942c-ea34d04e0d0c req-27aac946-26d8-4697-8731-375e4dc42436 service nova] Creating event network-vif-deleted:a803f95f-7afc-42f9-a263-976a6ba10f8f for instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b on hv-cinder-86249 Oct 24 13:41:51.568890 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-e9559b74-369d-45b4-942c-ea34d04e0d0c req-27aac946-26d8-4697-8731-375e4dc42436 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109343 Oct 24 13:41:51.569504 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 644/1291] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:52.068902 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-3e5f34ce-89f0-45fb-9bfb-d4a9090b7084 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:52.069571 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-3e5f34ce-89f0-45fb-9bfb-d4a9090b7084 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:41:52.075923 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3e5f34ce-89f0-45fb-9bfb-d4a9090b7084 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:52.076581 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3e5f34ce-89f0-45fb-9bfb-d4a9090b7084 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:52.077040 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3e5f34ce-89f0-45fb-9bfb-d4a9090b7084 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:52.077731 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3e5f34ce-89f0-45fb-9bfb-d4a9090b7084 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:52.078184 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3e5f34ce-89f0-45fb-9bfb-d4a9090b7084 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:52.078607 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3e5f34ce-89f0-45fb-9bfb-d4a9090b7084 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:52.109735 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3e5f34ce-89f0-45fb-9bfb-d4a9090b7084 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:52.110207 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3e5f34ce-89f0-45fb-9bfb-d4a9090b7084 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:52.110639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-3e5f34ce-89f0-45fb-9bfb-d4a9090b7084 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:52.111074 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.objects.instance [None req-3e5f34ce-89f0-45fb-9bfb-d4a9090b7084 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lazy-loading 'fault' on Instance uuid 50390c66-fb8d-4e03-96b9-7dfdc674d94b {{(pid=119145) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:41:52.155871 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-3e5f34ce-89f0-45fb-9bfb-d4a9090b7084 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:41:52.164654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-3e5f34ce-89f0-45fb-9bfb-d4a9090b7084 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 200 len: 1330 microversion: 2.1 time: 0.099772 Oct 24 13:41:52.165223 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 648/1292] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:41:52 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 1330 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:41:53.189519 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c4d98a19-1a77-4213-9958-649ed03561ee tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:53.190212 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c4d98a19-1a77-4213-9958-649ed03561ee tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:41:53.197147 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c4d98a19-1a77-4213-9958-649ed03561ee tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:53.198288 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c4d98a19-1a77-4213-9958-649ed03561ee tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:53.198288 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c4d98a19-1a77-4213-9958-649ed03561ee tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:53.198786 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c4d98a19-1a77-4213-9958-649ed03561ee tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:53.199229 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c4d98a19-1a77-4213-9958-649ed03561ee tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:53.199643 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c4d98a19-1a77-4213-9958-649ed03561ee tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:53.212837 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-c4d98a19-1a77-4213-9958-649ed03561ee tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] HTTP exception thrown: Instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b could not be found. Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c4d98a19-1a77-4213-9958-649ed03561ee tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Request method failure captured: Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b HTTP/1.1 Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpTbRRXQSAKwonVGeChkQxnwDI7hnY-9OBoe_qnbtdeMF_9XlbOZKw0JbfEXuhVi4scmDs_GUKvJoTXwlczS-zmtlXzqna6piOiITjfrb2p2E7hfxVXwAjE0Dt7XmIWSB362Q5Fsw_cewEhIEFbVblBQ6zgqJNdaeZDZqts2BcPdRJc Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:41:53.214441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:41:53.216344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0a7896472f034eb4b3b028d528cfbac0"}]}] Oct 24 13:41:53.216344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:41:53.216344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:41:53.216344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:41:53.216344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:41:53.216344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:41:53.216344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:41:53.216344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 54fcced6d8d943608b940d1dab001540 Oct 24 13:41:53.216344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:41:53.216344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:41:53.216344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b could not be found. Oct 24 13:41:53.216344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': '50390c66-fb8d-4e03-96b9-7dfdc674d94b'} Oct 24 13:41:53.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:41:53.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:53.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:41:53.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:41:53.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:41:53.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:41:53.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:41:53.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:41:53.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:41:53.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:41:53.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b could not be found. Oct 24 13:41:53.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:41:53.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:41:53.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:41:53.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:53.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:41:53.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:41:53.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:41:53.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:41:53.217299 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:41:53.218787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:41:53.218787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:41:53.218787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:41:53.218787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:41:53.218787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:41:53.218787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:41:53.218787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:41:53.218787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b could not be found. Oct 24 13:41:53.218787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:41:53.218787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:41:53.218787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:41:53.218787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:53.218787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:41:53.218787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:41:53.218787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:41:53.218787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:41:53.218787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b could not be found. Oct 24 13:41:53.218787 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:41:53.220088 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c4d98a19-1a77-4213-9958-649ed03561ee tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Returning 404 to user: Instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:41:53.220088 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c4d98a19-1a77-4213-9958-649ed03561ee tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 404 len: 111 microversion: 2.1 time: 0.030600 Oct 24 13:41:53.220088 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 645/1293] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:41:53 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:41:53.226158 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9b4d6b1e-15a8-40d1-86b1-62ce951ffb20 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '.version_select at 0x7f17a81da940>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:53.283767 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9b4d6b1e-15a8-40d1-86b1-62ce951ffb20 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-691003414" status: 202 len: 0 microversion: 2.1 time: 0.061960 Oct 24 13:41:53.284339 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 649/1294] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Oct 24 13:41:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-691003414 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:41:53.978197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3dc2d181-2f79-443c-82a6-a121f8c0e177 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Action: 'create', calling method: .version_select at 0x7f17a81b00d0>, body: {"keypair": {"name": "tempest-keypair-959413542", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5ZkBk9HeP823n5sNt/+U2eRHVDCAgGc/G1p0Xu7F59BPy55Z4ip/2Vmqm5zpCcGqatypkg4/kYQkayA/zjHwwI0QsatMVsiYGNm8c+iK0I+GYRgAPcbJ3LB43veNZJdw=="}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:41:53.994015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-3dc2d181-2f79-443c-82a6-a121f8c0e177 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Getting quotas for project 0a7896472f034eb4b3b028d528cfbac0. Resources: {'key_pairs'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:41:53.997974 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-3dc2d181-2f79-443c-82a6-a121f8c0e177 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Getting quotas for user 54fcced6d8d943608b940d1dab001540 and project 0a7896472f034eb4b3b028d528cfbac0. Resources: {'key_pairs'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:41:54.084493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3dc2d181-2f79-443c-82a6-a121f8c0e177 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.110886 Oct 24 13:41:54.085239 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 646/1295] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 24 13:41:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:56.135198 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9ba59ab4-1d47-4b4d-9a1e-e380d1467f82 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-497612384", "imageRef": "1a874490-179e-412c-895e-52b16935c04c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b68375da-958f-473f-9389-64a90da42e86"}], "security_groups": [{"name": "tempest-securitygroup--347364607"}], "key_name": "tempest-keypair-959413542", "user_data": "}} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:41:56.235472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.network.neutron [None req-9ba59ab4-1d47-4b4d-9a1e-e380d1467f82 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] validate_networks() for [('b68375da-958f-473f-9389-64a90da42e86', None, None, None, None, None)] {{(pid=119145) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:41:56.596176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-9ba59ab4-1d47-4b4d-9a1e-e380d1467f82 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Flavor limits 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:41:56.596639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-9ba59ab4-1d47-4b4d-9a1e-e380d1467f82 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Image limits 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:41:56.597111 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-9ba59ab4-1d47-4b4d-9a1e-e380d1467f82 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Flavor pref 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:41:56.597515 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-9ba59ab4-1d47-4b4d-9a1e-e380d1467f82 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Image pref 0:0:0 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:41:56.597919 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.virt.hardware [None req-9ba59ab4-1d47-4b4d-9a1e-e380d1467f82 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119145) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:41:56.607170 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ba59ab4-1d47-4b4d-9a1e-e380d1467f82 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:56.607648 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ba59ab4-1d47-4b4d-9a1e-e380d1467f82 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:56.608076 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ba59ab4-1d47-4b4d-9a1e-e380d1467f82 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:56.608833 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ba59ab4-1d47-4b4d-9a1e-e380d1467f82 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:56.609280 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ba59ab4-1d47-4b4d-9a1e-e380d1467f82 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:56.609700 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ba59ab4-1d47-4b4d-9a1e-e380d1467f82 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:56.627298 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-9ba59ab4-1d47-4b4d-9a1e-e380d1467f82 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Getting quotas for project 0a7896472f034eb4b3b028d528cfbac0. Resources: {'ram', 'instances', 'cores'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:41:56.631223 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.quota [None req-9ba59ab4-1d47-4b4d-9a1e-e380d1467f82 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Getting quotas for user 54fcced6d8d943608b940d1dab001540 and project 0a7896472f034eb4b3b028d528cfbac0. Resources: {'ram', 'instances', 'cores'} {{(pid=119145) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:41:56.641961 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9ba59ab4-1d47-4b4d-9a1e-e380d1467f82 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Going to run 1 instances... {{(pid=119145) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:41:56.644208 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9ba59ab4-1d47-4b4d-9a1e-e380d1467f82 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a874490-179e-412c-895e-52b16935c04c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119145) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:41:56.759646 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9ba59ab4-1d47-4b4d-9a1e-e380d1467f82 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.629938 Oct 24 13:41:56.760321 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 650/1296] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 24 13:41:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:41:56.771957 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a0d04875-ae52-4a8b-97fb-050b1df796b1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:56.777663 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a0d04875-ae52-4a8b-97fb-050b1df796b1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:41:56.829972 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a0d04875-ae52-4a8b-97fb-050b1df796b1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:41:56.837257 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a0d04875-ae52-4a8b-97fb-050b1df796b1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 200 len: 1240 microversion: 2.1 time: 0.069615 Oct 24 13:41:56.837821 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 647/1297] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:41:56 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:41:57.862892 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6371fea4-3149-454e-b2ac-986c48c7d09f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:57.863500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-6371fea4-3149-454e-b2ac-986c48c7d09f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:41:57.870166 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6371fea4-3149-454e-b2ac-986c48c7d09f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:57.870635 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6371fea4-3149-454e-b2ac-986c48c7d09f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:57.871059 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6371fea4-3149-454e-b2ac-986c48c7d09f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:57.871729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6371fea4-3149-454e-b2ac-986c48c7d09f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:57.872169 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6371fea4-3149-454e-b2ac-986c48c7d09f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:57.872604 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6371fea4-3149-454e-b2ac-986c48c7d09f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:57.934473 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-6371fea4-3149-454e-b2ac-986c48c7d09f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:41:57.943014 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6371fea4-3149-454e-b2ac-986c48c7d09f tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 200 len: 1244 microversion: 2.1 time: 0.084544 Oct 24 13:41:57.943659 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 651/1298] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:41:57 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:41:58.966545 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a044b629-fab2-4251-9a6d-90121136842a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:58.967158 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a044b629-fab2-4251-9a6d-90121136842a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:41:58.974941 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a044b629-fab2-4251-9a6d-90121136842a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:58.981814 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a044b629-fab2-4251-9a6d-90121136842a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:58.981814 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a044b629-fab2-4251-9a6d-90121136842a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:58.981814 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a044b629-fab2-4251-9a6d-90121136842a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:58.981814 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a044b629-fab2-4251-9a6d-90121136842a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:58.983062 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a044b629-fab2-4251-9a6d-90121136842a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:59.046129 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a044b629-fab2-4251-9a6d-90121136842a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:41:59.054502 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a044b629-fab2-4251-9a6d-90121136842a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 200 len: 1298 microversion: 2.1 time: 0.092807 Oct 24 13:41:59.055161 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 648/1299] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:41:58 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:00.077684 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9ab0f096-c821-43d7-b005-c07a35541137 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:00.078289 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9ab0f096-c821-43d7-b005-c07a35541137 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:00.085252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ab0f096-c821-43d7-b005-c07a35541137 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:00.085967 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ab0f096-c821-43d7-b005-c07a35541137 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:00.086575 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ab0f096-c821-43d7-b005-c07a35541137 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:00.087491 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ab0f096-c821-43d7-b005-c07a35541137 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:00.088105 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ab0f096-c821-43d7-b005-c07a35541137 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:00.088540 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9ab0f096-c821-43d7-b005-c07a35541137 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:00.272340 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9ab0f096-c821-43d7-b005-c07a35541137 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:00.279911 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9ab0f096-c821-43d7-b005-c07a35541137 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 200 len: 1365 microversion: 2.1 time: 0.206142 Oct 24 13:42:00.280508 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 652/1300] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:00 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:00.375763 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-f1e332e2-cf22-48eb-a244-157e7049a67e req-9574fc48-c1fa-4028-b301-e8f98277ef04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb9098c2-59fd-40de-8d8a-e326307949d8", "tag": "f9a14a79-1a72-49eb-9f40-e0e7455d83ef"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:42:00.386768 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-f1e332e2-cf22-48eb-a244-157e7049a67e req-9574fc48-c1fa-4028-b301-e8f98277ef04 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:00.390077 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-f1e332e2-cf22-48eb-a244-157e7049a67e req-9574fc48-c1fa-4028-b301-e8f98277ef04 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:00.390077 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-f1e332e2-cf22-48eb-a244-157e7049a67e req-9574fc48-c1fa-4028-b301-e8f98277ef04 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:00.400130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-f1e332e2-cf22-48eb-a244-157e7049a67e req-9574fc48-c1fa-4028-b301-e8f98277ef04 service nova] Creating event network-changed:f9a14a79-1a72-49eb-9f40-e0e7455d83ef for instance fb9098c2-59fd-40de-8d8a-e326307949d8 on hv-cinder-86249 Oct 24 13:42:00.405234 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-f1e332e2-cf22-48eb-a244-157e7049a67e req-9574fc48-c1fa-4028-b301-e8f98277ef04 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033437 Oct 24 13:42:00.405847 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 649/1301] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:42:01.302829 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-4b8aa8ce-1441-4bc6-8a45-0016e4fc0298 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:01.303499 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-4b8aa8ce-1441-4bc6-8a45-0016e4fc0298 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:01.310065 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4b8aa8ce-1441-4bc6-8a45-0016e4fc0298 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:01.310493 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4b8aa8ce-1441-4bc6-8a45-0016e4fc0298 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:01.310920 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4b8aa8ce-1441-4bc6-8a45-0016e4fc0298 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:01.311608 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4b8aa8ce-1441-4bc6-8a45-0016e4fc0298 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:01.312057 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4b8aa8ce-1441-4bc6-8a45-0016e4fc0298 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:01.312617 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-4b8aa8ce-1441-4bc6-8a45-0016e4fc0298 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:01.446062 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-4b8aa8ce-1441-4bc6-8a45-0016e4fc0298 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:01.453639 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-4b8aa8ce-1441-4bc6-8a45-0016e4fc0298 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 200 len: 1365 microversion: 2.1 time: 0.155591 Oct 24 13:42:01.454200 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 653/1302] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:01 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:02.477777 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bf1bd7a9-f347-4db7-8310-9e0d5cc2a4ef tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:02.478513 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bf1bd7a9-f347-4db7-8310-9e0d5cc2a4ef tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:02.484723 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bf1bd7a9-f347-4db7-8310-9e0d5cc2a4ef tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:02.485203 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bf1bd7a9-f347-4db7-8310-9e0d5cc2a4ef tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:02.485637 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bf1bd7a9-f347-4db7-8310-9e0d5cc2a4ef tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:02.486326 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bf1bd7a9-f347-4db7-8310-9e0d5cc2a4ef tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:02.486781 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bf1bd7a9-f347-4db7-8310-9e0d5cc2a4ef tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:02.487207 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bf1bd7a9-f347-4db7-8310-9e0d5cc2a4ef tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:02.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-bf1bd7a9-f347-4db7-8310-9e0d5cc2a4ef tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:02.620805 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-bf1bd7a9-f347-4db7-8310-9e0d5cc2a4ef tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 200 len: 1365 microversion: 2.1 time: 0.148410 Oct 24 13:42:02.621402 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 650/1303] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:02 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:03.644233 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-90e10640-3e77-4a10-b8fb-5de47b2b4e1b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:03.644927 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-90e10640-3e77-4a10-b8fb-5de47b2b4e1b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:03.651392 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-90e10640-3e77-4a10-b8fb-5de47b2b4e1b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:03.651867 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-90e10640-3e77-4a10-b8fb-5de47b2b4e1b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:03.652322 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-90e10640-3e77-4a10-b8fb-5de47b2b4e1b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:03.653006 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-90e10640-3e77-4a10-b8fb-5de47b2b4e1b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:03.653451 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-90e10640-3e77-4a10-b8fb-5de47b2b4e1b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:03.653867 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-90e10640-3e77-4a10-b8fb-5de47b2b4e1b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:03.780163 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-90e10640-3e77-4a10-b8fb-5de47b2b4e1b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:03.787908 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-90e10640-3e77-4a10-b8fb-5de47b2b4e1b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 200 len: 1365 microversion: 2.1 time: 0.147712 Oct 24 13:42:03.788510 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 654/1304] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:03 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:04.810719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-86aec097-b4b3-45b8-8b55-dc01eebbecbf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:04.811331 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-86aec097-b4b3-45b8-8b55-dc01eebbecbf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:04.817868 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-86aec097-b4b3-45b8-8b55-dc01eebbecbf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:04.818865 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-86aec097-b4b3-45b8-8b55-dc01eebbecbf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:04.819305 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-86aec097-b4b3-45b8-8b55-dc01eebbecbf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:04.819990 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-86aec097-b4b3-45b8-8b55-dc01eebbecbf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:04.820722 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-86aec097-b4b3-45b8-8b55-dc01eebbecbf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:04.821144 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-86aec097-b4b3-45b8-8b55-dc01eebbecbf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:04.947476 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-86aec097-b4b3-45b8-8b55-dc01eebbecbf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:04.955285 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-86aec097-b4b3-45b8-8b55-dc01eebbecbf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 200 len: 1365 microversion: 2.1 time: 0.148527 Oct 24 13:42:04.955858 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 651/1305] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:04 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:05.979248 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-76605ab9-10c6-4caf-b526-b49e460e41f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:05.979865 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-76605ab9-10c6-4caf-b526-b49e460e41f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:05.986265 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76605ab9-10c6-4caf-b526-b49e460e41f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:05.986732 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76605ab9-10c6-4caf-b526-b49e460e41f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:05.987158 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76605ab9-10c6-4caf-b526-b49e460e41f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:05.987835 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76605ab9-10c6-4caf-b526-b49e460e41f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:05.988296 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76605ab9-10c6-4caf-b526-b49e460e41f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:05.988717 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76605ab9-10c6-4caf-b526-b49e460e41f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:06.119016 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-76605ab9-10c6-4caf-b526-b49e460e41f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:06.126897 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-76605ab9-10c6-4caf-b526-b49e460e41f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 200 len: 1365 microversion: 2.1 time: 0.152170 Oct 24 13:42:06.127464 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 655/1306] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:05 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:07.150136 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c11aaf49-1c1d-480e-a5f7-a9cc69905d19 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:07.150798 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c11aaf49-1c1d-480e-a5f7-a9cc69905d19 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:07.153180 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=6 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:07.158037 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c11aaf49-1c1d-480e-a5f7-a9cc69905d19 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:07.158506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c11aaf49-1c1d-480e-a5f7-a9cc69905d19 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:07.158936 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c11aaf49-1c1d-480e-a5f7-a9cc69905d19 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:07.159614 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c11aaf49-1c1d-480e-a5f7-a9cc69905d19 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:07.160056 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c11aaf49-1c1d-480e-a5f7-a9cc69905d19 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:07.160493 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c11aaf49-1c1d-480e-a5f7-a9cc69905d19 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:07.291415 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c11aaf49-1c1d-480e-a5f7-a9cc69905d19 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:07.298996 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c11aaf49-1c1d-480e-a5f7-a9cc69905d19 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 200 len: 1365 microversion: 2.1 time: 0.152909 Oct 24 13:42:07.299563 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 652/1307] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:07 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:08.194681 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=2 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:08.197248 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=6 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:08.249405 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-930e2701-e43c-4bca-8250-a17696ae5309 req-db8e9cd1-9e61-483b-8e8d-6431c62f6107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb9098c2-59fd-40de-8d8a-e326307949d8", "name": "network-vif-plugged", "status": "completed", "tag": "f9a14a79-1a72-49eb-9f40-e0e7455d83ef"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:42:08.258656 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-930e2701-e43c-4bca-8250-a17696ae5309 req-db8e9cd1-9e61-483b-8e8d-6431c62f6107 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:08.259123 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-930e2701-e43c-4bca-8250-a17696ae5309 req-db8e9cd1-9e61-483b-8e8d-6431c62f6107 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:08.259545 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-930e2701-e43c-4bca-8250-a17696ae5309 req-db8e9cd1-9e61-483b-8e8d-6431c62f6107 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:08.270559 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-930e2701-e43c-4bca-8250-a17696ae5309 req-db8e9cd1-9e61-483b-8e8d-6431c62f6107 service nova] Creating event network-vif-plugged:f9a14a79-1a72-49eb-9f40-e0e7455d83ef for instance fb9098c2-59fd-40de-8d8a-e326307949d8 on hv-cinder-86249 Oct 24 13:42:08.276428 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-930e2701-e43c-4bca-8250-a17696ae5309 req-db8e9cd1-9e61-483b-8e8d-6431c62f6107 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086055 Oct 24 13:42:08.277028 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 656/1308] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:42:08.323391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-5bcfa5d5-e65c-48aa-94f2-19b623be99b5 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:08.324041 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-5bcfa5d5-e65c-48aa-94f2-19b623be99b5 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:08.327532 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:08.330954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5bcfa5d5-e65c-48aa-94f2-19b623be99b5 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:08.335015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5bcfa5d5-e65c-48aa-94f2-19b623be99b5 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:08.335015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5bcfa5d5-e65c-48aa-94f2-19b623be99b5 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:08.335015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5bcfa5d5-e65c-48aa-94f2-19b623be99b5 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:08.335015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5bcfa5d5-e65c-48aa-94f2-19b623be99b5 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:08.335439 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-5bcfa5d5-e65c-48aa-94f2-19b623be99b5 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:08.338291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:08.465471 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-5bcfa5d5-e65c-48aa-94f2-19b623be99b5 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:08.473007 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-5bcfa5d5-e65c-48aa-94f2-19b623be99b5 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 200 len: 1365 microversion: 2.1 time: 0.153867 Oct 24 13:42:08.473581 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 653/1309] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:08 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:09.498382 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a95990c8-729e-4e9b-b6dc-46e5199f66bf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:09.499110 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a95990c8-729e-4e9b-b6dc-46e5199f66bf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:09.505215 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a95990c8-729e-4e9b-b6dc-46e5199f66bf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:09.505691 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a95990c8-729e-4e9b-b6dc-46e5199f66bf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:09.506128 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a95990c8-729e-4e9b-b6dc-46e5199f66bf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:09.506803 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a95990c8-729e-4e9b-b6dc-46e5199f66bf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:09.507252 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a95990c8-729e-4e9b-b6dc-46e5199f66bf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:09.507670 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a95990c8-729e-4e9b-b6dc-46e5199f66bf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:09.635989 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a95990c8-729e-4e9b-b6dc-46e5199f66bf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:09.643635 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a95990c8-729e-4e9b-b6dc-46e5199f66bf tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 200 len: 1365 microversion: 2.1 time: 0.150474 Oct 24 13:42:09.644207 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 657/1310] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:09 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:10.667291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-eaa9abee-0562-4da2-b901-9bbccc94c3a1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:10.667927 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-eaa9abee-0562-4da2-b901-9bbccc94c3a1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:10.675555 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eaa9abee-0562-4da2-b901-9bbccc94c3a1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:10.678309 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eaa9abee-0562-4da2-b901-9bbccc94c3a1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:10.678309 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eaa9abee-0562-4da2-b901-9bbccc94c3a1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:10.678309 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eaa9abee-0562-4da2-b901-9bbccc94c3a1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:10.678309 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eaa9abee-0562-4da2-b901-9bbccc94c3a1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:10.678724 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-eaa9abee-0562-4da2-b901-9bbccc94c3a1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:10.807960 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-eaa9abee-0562-4da2-b901-9bbccc94c3a1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:10.815558 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-eaa9abee-0562-4da2-b901-9bbccc94c3a1 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 200 len: 1554 microversion: 2.1 time: 0.153214 Oct 24 13:42:10.816122 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 654/1311] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:10 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:10.838873 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-bc79147a-9b94-4579-8b52-a0047bea34e7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:10.839359 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-bc79147a-9b94-4579-8b52-a0047bea34e7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:10.845726 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bc79147a-9b94-4579-8b52-a0047bea34e7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:10.846567 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bc79147a-9b94-4579-8b52-a0047bea34e7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:10.846989 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bc79147a-9b94-4579-8b52-a0047bea34e7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:10.847662 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bc79147a-9b94-4579-8b52-a0047bea34e7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:10.848104 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bc79147a-9b94-4579-8b52-a0047bea34e7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:10.848538 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bc79147a-9b94-4579-8b52-a0047bea34e7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:10.926236 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-bc79147a-9b94-4579-8b52-a0047bea34e7 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091717 Oct 24 13:42:10.926853 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 658/1312] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 24 13:42:10 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:42:11.893049 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-491141af-5505-400e-8f78-dd7e1de86f8f req-65b21bba-fbb8-4ad4-b994-a07c63923fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb9098c2-59fd-40de-8d8a-e326307949d8", "tag": "f9a14a79-1a72-49eb-9f40-e0e7455d83ef"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:42:11.897349 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-491141af-5505-400e-8f78-dd7e1de86f8f req-65b21bba-fbb8-4ad4-b994-a07c63923fab service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:11.897833 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-491141af-5505-400e-8f78-dd7e1de86f8f req-65b21bba-fbb8-4ad4-b994-a07c63923fab service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:11.898257 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-491141af-5505-400e-8f78-dd7e1de86f8f req-65b21bba-fbb8-4ad4-b994-a07c63923fab service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:11.909110 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-491141af-5505-400e-8f78-dd7e1de86f8f req-65b21bba-fbb8-4ad4-b994-a07c63923fab service nova] Creating event network-changed:f9a14a79-1a72-49eb-9f40-e0e7455d83ef for instance fb9098c2-59fd-40de-8d8a-e326307949d8 on hv-cinder-86249 Oct 24 13:42:11.914542 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-491141af-5505-400e-8f78-dd7e1de86f8f req-65b21bba-fbb8-4ad4-b994-a07c63923fab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030583 Oct 24 13:42:11.915147 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 655/1313] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:42:25.913294 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:25.914152 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=82 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:25.915257 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=5 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:25.916025 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=13 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:25.918227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-61d2a107-958e-47f4-aa8e-79d624058158 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:25.918729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-61d2a107-958e-47f4-aa8e-79d624058158 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:25.919923 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-dd13d169-3661-480e-a0b7-d1940dfd262f req-a4bf744c-0da5-4d5c-afd4-9a066731b9db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42bdff1e-48cd-4c08-a043-0e592c6d119c", "tag": "e309bad0-13db-408d-9058-da5aa46fcee8"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:42:25.924884 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-61d2a107-958e-47f4-aa8e-79d624058158 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:25.925364 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-61d2a107-958e-47f4-aa8e-79d624058158 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:25.925790 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-61d2a107-958e-47f4-aa8e-79d624058158 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:25.926502 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-61d2a107-958e-47f4-aa8e-79d624058158 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:25.926953 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-61d2a107-958e-47f4-aa8e-79d624058158 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:25.927381 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-61d2a107-958e-47f4-aa8e-79d624058158 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:25.929376 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-dd13d169-3661-480e-a0b7-d1940dfd262f req-a4bf744c-0da5-4d5c-afd4-9a066731b9db service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:25.929847 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-dd13d169-3661-480e-a0b7-d1940dfd262f req-a4bf744c-0da5-4d5c-afd4-9a066731b9db service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:25.930273 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-dd13d169-3661-480e-a0b7-d1940dfd262f req-a4bf744c-0da5-4d5c-afd4-9a066731b9db service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:25.941757 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-dd13d169-3661-480e-a0b7-d1940dfd262f req-a4bf744c-0da5-4d5c-afd4-9a066731b9db service nova] Creating event network-changed:e309bad0-13db-408d-9058-da5aa46fcee8 for instance 42bdff1e-48cd-4c08-a043-0e592c6d119c on hv-cinder-86249 Oct 24 13:42:25.947767 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-dd13d169-3661-480e-a0b7-d1940dfd262f req-a4bf744c-0da5-4d5c-afd4-9a066731b9db service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033416 Oct 24 13:42:25.948600 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 656/1314] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:42:25.954894 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-61d2a107-958e-47f4-aa8e-79d624058158 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Going to try to terminate instance {{(pid=119145) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:42:26.266186 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-61d2a107-958e-47f4-aa8e-79d624058158 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "DELETE /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 204 len: 0 microversion: 2.1 time: 0.354590 Oct 24 13:42:26.267189 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 659/1315] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:42:25 2022] DELETE /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:42:26.275832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3867ff2c-a90f-4210-b1aa-793d7895b72d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:26.276865 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-3867ff2c-a90f-4210-b1aa-793d7895b72d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:26.287957 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3867ff2c-a90f-4210-b1aa-793d7895b72d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:26.288794 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3867ff2c-a90f-4210-b1aa-793d7895b72d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:26.289232 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3867ff2c-a90f-4210-b1aa-793d7895b72d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:26.289938 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3867ff2c-a90f-4210-b1aa-793d7895b72d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:26.290912 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3867ff2c-a90f-4210-b1aa-793d7895b72d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:26.291379 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3867ff2c-a90f-4210-b1aa-793d7895b72d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:26.424078 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-3867ff2c-a90f-4210-b1aa-793d7895b72d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:26.432443 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3867ff2c-a90f-4210-b1aa-793d7895b72d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1573 microversion: 2.1 time: 0.160920 Oct 24 13:42:26.433016 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 657/1316] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:26 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:27.456778 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-74c186ba-a544-4edc-8915-7a23bec2a95a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:27.457478 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-74c186ba-a544-4edc-8915-7a23bec2a95a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:27.464358 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-74c186ba-a544-4edc-8915-7a23bec2a95a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:27.464834 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-74c186ba-a544-4edc-8915-7a23bec2a95a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:27.465260 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-74c186ba-a544-4edc-8915-7a23bec2a95a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:27.465938 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-74c186ba-a544-4edc-8915-7a23bec2a95a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:27.466381 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-74c186ba-a544-4edc-8915-7a23bec2a95a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:27.466800 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-74c186ba-a544-4edc-8915-7a23bec2a95a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:27.881848 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-74c186ba-a544-4edc-8915-7a23bec2a95a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:27.889560 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-74c186ba-a544-4edc-8915-7a23bec2a95a tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1573 microversion: 2.1 time: 0.437130 Oct 24 13:42:27.890130 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 660/1317] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:27 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1573 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:28.588015 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-b0ed3f06-d14b-42ec-902d-0bf005c9d13a req-3e7c2a1c-0490-4764-963f-30b731cb962c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42bdff1e-48cd-4c08-a043-0e592c6d119c", "name": "network-vif-deleted", "tag": "e309bad0-13db-408d-9058-da5aa46fcee8"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:42:28.597643 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-b0ed3f06-d14b-42ec-902d-0bf005c9d13a req-3e7c2a1c-0490-4764-963f-30b731cb962c service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:28.603395 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-b0ed3f06-d14b-42ec-902d-0bf005c9d13a req-3e7c2a1c-0490-4764-963f-30b731cb962c service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:28.603395 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-b0ed3f06-d14b-42ec-902d-0bf005c9d13a req-3e7c2a1c-0490-4764-963f-30b731cb962c service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:28.610212 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-b0ed3f06-d14b-42ec-902d-0bf005c9d13a req-3e7c2a1c-0490-4764-963f-30b731cb962c service nova] Creating event network-vif-deleted:e309bad0-13db-408d-9058-da5aa46fcee8 for instance 42bdff1e-48cd-4c08-a043-0e592c6d119c on hv-cinder-86249 Oct 24 13:42:28.615215 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-b0ed3f06-d14b-42ec-902d-0bf005c9d13a req-3e7c2a1c-0490-4764-963f-30b731cb962c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030997 Oct 24 13:42:28.615824 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 658/1318] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:42:28.912380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f1ce02ec-aac8-416e-8ac9-2e2d0a489f06 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:28.912942 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f1ce02ec-aac8-416e-8ac9-2e2d0a489f06 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:28.920221 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f1ce02ec-aac8-416e-8ac9-2e2d0a489f06 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:28.921010 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f1ce02ec-aac8-416e-8ac9-2e2d0a489f06 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:28.921443 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f1ce02ec-aac8-416e-8ac9-2e2d0a489f06 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:28.922147 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f1ce02ec-aac8-416e-8ac9-2e2d0a489f06 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:28.922596 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f1ce02ec-aac8-416e-8ac9-2e2d0a489f06 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:28.923014 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f1ce02ec-aac8-416e-8ac9-2e2d0a489f06 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:28.991395 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-f1ce02ec-aac8-416e-8ac9-2e2d0a489f06 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:29.000249 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f1ce02ec-aac8-416e-8ac9-2e2d0a489f06 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 200 len: 1225 microversion: 2.1 time: 0.091572 Oct 24 13:42:29.000940 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 661/1319] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:28 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:30.024031 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-4872c6bb-746c-4a8e-b05a-92c673571f89 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:30.025680 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-4872c6bb-746c-4a8e-b05a-92c673571f89 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 42bdff1e-48cd-4c08-a043-0e592c6d119c] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:30.032116 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4872c6bb-746c-4a8e-b05a-92c673571f89 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:30.032634 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4872c6bb-746c-4a8e-b05a-92c673571f89 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:30.033069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4872c6bb-746c-4a8e-b05a-92c673571f89 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:30.033766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4872c6bb-746c-4a8e-b05a-92c673571f89 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:30.034250 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4872c6bb-746c-4a8e-b05a-92c673571f89 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:30.034671 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4872c6bb-746c-4a8e-b05a-92c673571f89 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:30.048758 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-4872c6bb-746c-4a8e-b05a-92c673571f89 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] HTTP exception thrown: Instance 42bdff1e-48cd-4c08-a043-0e592c6d119c could not be found. Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-4872c6bb-746c-4a8e-b05a-92c673571f89 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Request method failure captured: Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c HTTP/1.1 Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpRbhxdELZc_i7DhRs5HUpO2Kh4fAQXjI9jJyU_R-Dsn6Pa4_WBn9qUrvbf3M8ir7YbciC6xRkl42wHqEUd0Mf-3NluUUfDljmG9smj9tmXhbdwN90uixbTLb22N61tZT9VccVcNcLOqcQFqYmYP3u5lK5kBhSxDok0TbgxsEmsFoBs Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 46d41e46b7e3415684c32b22f31eefb5 Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-TestVolumeBootPattern-331217562 Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:42:30.050377 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:42:30.052391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_46d41e46b7e3415684c32b22f31eefb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46d41e46b7e3415684c32b22f31eefb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46d41e46b7e3415684c32b22f31eefb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/46d41e46b7e3415684c32b22f31eefb5"}]}] Oct 24 13:42:30.052391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-TestVolumeBootPattern-331217562 Oct 24 13:42:30.052391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 46d41e46b7e3415684c32b22f31eefb5 Oct 24 13:42:30.052391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-TestVolumeBootPattern-331217562 Oct 24 13:42:30.052391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-TestVolumeBootPattern-331217562-project Oct 24 13:42:30.052391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:42:30.052391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:42:30.052391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: cbdf62fbe49d44a58c294ac2c8b22ef5 Oct 24 13:42:30.052391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-TestVolumeBootPattern-331217562-project Oct 24 13:42:30.052391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:42:30.052391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Instance 42bdff1e-48cd-4c08-a043-0e592c6d119c could not be found. Oct 24 13:42:30.052391 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': '42bdff1e-48cd-4c08-a043-0e592c6d119c'} Oct 24 13:42:30.053335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:42:30.053335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:42:30.053335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:42:30.053335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:42:30.053335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:42:30.053335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:42:30.053335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:42:30.053335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:42:30.053335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:42:30.053335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:42:30.053335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42bdff1e-48cd-4c08-a043-0e592c6d119c could not be found. Oct 24 13:42:30.053335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:42:30.053335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:42:30.053335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:42:30.053335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:42:30.053335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:42:30.053335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:42:30.053335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:42:30.053335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:42:30.053335 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:42:30.054981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:42:30.054981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:42:30.054981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:42:30.054981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:42:30.054981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:42:30.054981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:42:30.054981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:42:30.054981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42bdff1e-48cd-4c08-a043-0e592c6d119c could not be found. Oct 24 13:42:30.054981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:42:30.054981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:42:30.054981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:42:30.054981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:42:30.054981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:42:30.054981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:42:30.054981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:42:30.054981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:42:30.054981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42bdff1e-48cd-4c08-a043-0e592c6d119c could not be found. Oct 24 13:42:30.054981 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:42:30.056339 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-4872c6bb-746c-4a8e-b05a-92c673571f89 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Returning 404 to user: Instance 42bdff1e-48cd-4c08-a043-0e592c6d119c could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:42:30.056339 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-4872c6bb-746c-4a8e-b05a-92c673571f89 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c" status: 404 len: 111 microversion: 2.1 time: 0.032497 Oct 24 13:42:30.056339 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 659/1320] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:30 2022] GET /compute/v2.1/servers/42bdff1e-48cd-4c08-a043-0e592c6d119c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:42:33.394866 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a1e8b407-0c0d-4846-927a-b0f598ec9072 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:33.395359 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a1e8b407-0c0d-4846-927a-b0f598ec9072 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:33.400543 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-976ee2ba-b034-4ccc-bd75-c4f2d4ef6ed3 req-d3ac83e1-2ad6-4455-8282-34436ea1c21e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a8e9668-965e-444d-87c1-5fe36bc3b0ab", "tag": "675c4dae-b73b-4796-ba50-70bc5bd72f10"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:42:33.401991 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1e8b407-0c0d-4846-927a-b0f598ec9072 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:33.402588 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1e8b407-0c0d-4846-927a-b0f598ec9072 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:33.403527 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1e8b407-0c0d-4846-927a-b0f598ec9072 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:33.404220 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1e8b407-0c0d-4846-927a-b0f598ec9072 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:33.404704 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1e8b407-0c0d-4846-927a-b0f598ec9072 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:33.405123 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a1e8b407-0c0d-4846-927a-b0f598ec9072 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:33.411565 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-976ee2ba-b034-4ccc-bd75-c4f2d4ef6ed3 req-d3ac83e1-2ad6-4455-8282-34436ea1c21e service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:33.412036 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-976ee2ba-b034-4ccc-bd75-c4f2d4ef6ed3 req-d3ac83e1-2ad6-4455-8282-34436ea1c21e service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:33.412486 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-976ee2ba-b034-4ccc-bd75-c4f2d4ef6ed3 req-d3ac83e1-2ad6-4455-8282-34436ea1c21e service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:33.424438 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-976ee2ba-b034-4ccc-bd75-c4f2d4ef6ed3 req-d3ac83e1-2ad6-4455-8282-34436ea1c21e service nova] Creating event network-changed:675c4dae-b73b-4796-ba50-70bc5bd72f10 for instance 3a8e9668-965e-444d-87c1-5fe36bc3b0ab on hv-cinder-86249 Oct 24 13:42:33.429706 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-976ee2ba-b034-4ccc-bd75-c4f2d4ef6ed3 req-d3ac83e1-2ad6-4455-8282-34436ea1c21e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032898 Oct 24 13:42:33.430671 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 660/1321] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:42:33.435236 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a1e8b407-0c0d-4846-927a-b0f598ec9072 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Going to try to terminate instance {{(pid=119145) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:42:33.696473 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a1e8b407-0c0d-4846-927a-b0f598ec9072 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 204 len: 0 microversion: 2.1 time: 0.305279 Oct 24 13:42:33.697801 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 662/1322] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:42:33 2022] DELETE /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:42:33.706638 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-4cd66f0e-fc06-40ba-a839-a8eb7f18023f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:33.707627 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-4cd66f0e-fc06-40ba-a839-a8eb7f18023f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:33.714221 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4cd66f0e-fc06-40ba-a839-a8eb7f18023f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:33.714944 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4cd66f0e-fc06-40ba-a839-a8eb7f18023f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:33.715930 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4cd66f0e-fc06-40ba-a839-a8eb7f18023f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:33.716719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4cd66f0e-fc06-40ba-a839-a8eb7f18023f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:33.717110 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4cd66f0e-fc06-40ba-a839-a8eb7f18023f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:33.717529 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-4cd66f0e-fc06-40ba-a839-a8eb7f18023f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:33.852020 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-4cd66f0e-fc06-40ba-a839-a8eb7f18023f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:33.859743 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-4cd66f0e-fc06-40ba-a839-a8eb7f18023f tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1576 microversion: 2.1 time: 0.157333 Oct 24 13:42:33.860362 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 661/1323] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:33 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:34.883560 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-bde9b228-f200-48b1-a1e4-25142a52e858 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:34.884260 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-bde9b228-f200-48b1-a1e4-25142a52e858 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:34.890821 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bde9b228-f200-48b1-a1e4-25142a52e858 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:34.891302 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bde9b228-f200-48b1-a1e4-25142a52e858 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:34.891735 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bde9b228-f200-48b1-a1e4-25142a52e858 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:34.892541 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bde9b228-f200-48b1-a1e4-25142a52e858 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:34.892996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bde9b228-f200-48b1-a1e4-25142a52e858 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:34.893418 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-bde9b228-f200-48b1-a1e4-25142a52e858 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:35.121448 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-bde9b228-f200-48b1-a1e4-25142a52e858 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:35.129115 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-bde9b228-f200-48b1-a1e4-25142a52e858 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1576 microversion: 2.1 time: 0.249889 Oct 24 13:42:35.129694 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 663/1324] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:34 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1576 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:36.152065 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-e29a23ba-a3cc-4c8f-b650-a77c76b23658 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:36.152731 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-e29a23ba-a3cc-4c8f-b650-a77c76b23658 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:36.159592 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e29a23ba-a3cc-4c8f-b650-a77c76b23658 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:36.160079 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e29a23ba-a3cc-4c8f-b650-a77c76b23658 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:36.160536 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e29a23ba-a3cc-4c8f-b650-a77c76b23658 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:36.161239 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e29a23ba-a3cc-4c8f-b650-a77c76b23658 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:36.161695 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e29a23ba-a3cc-4c8f-b650-a77c76b23658 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:36.162115 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-e29a23ba-a3cc-4c8f-b650-a77c76b23658 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:36.547120 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-e29a23ba-a3cc-4c8f-b650-a77c76b23658 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:36.555171 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-e29a23ba-a3cc-4c8f-b650-a77c76b23658 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1457 microversion: 2.1 time: 0.407025 Oct 24 13:42:36.560905 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 662/1325] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:36 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1457 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:36.561509 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-5771434e-2bc9-4c65-b0dd-34747857b8c6 req-991ab817-07e5-4997-93d5-426c430259fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a8e9668-965e-444d-87c1-5fe36bc3b0ab", "name": "network-vif-deleted", "tag": "675c4dae-b73b-4796-ba50-70bc5bd72f10"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:42:36.571457 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-5771434e-2bc9-4c65-b0dd-34747857b8c6 req-991ab817-07e5-4997-93d5-426c430259fe service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:36.571955 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-5771434e-2bc9-4c65-b0dd-34747857b8c6 req-991ab817-07e5-4997-93d5-426c430259fe service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:36.572405 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-5771434e-2bc9-4c65-b0dd-34747857b8c6 req-991ab817-07e5-4997-93d5-426c430259fe service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:36.584341 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-5771434e-2bc9-4c65-b0dd-34747857b8c6 req-991ab817-07e5-4997-93d5-426c430259fe service nova] Creating event network-vif-deleted:675c4dae-b73b-4796-ba50-70bc5bd72f10 for instance 3a8e9668-965e-444d-87c1-5fe36bc3b0ab on hv-cinder-86249 Oct 24 13:42:36.589100 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-5771434e-2bc9-4c65-b0dd-34747857b8c6 req-991ab817-07e5-4997-93d5-426c430259fe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031996 Oct 24 13:42:36.590032 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 664/1326] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:42:37.580489 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-f072a6f8-f294-40b2-8f20-9e30524fc50d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:37.581096 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-f072a6f8-f294-40b2-8f20-9e30524fc50d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:37.587719 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f072a6f8-f294-40b2-8f20-9e30524fc50d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:37.588732 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f072a6f8-f294-40b2-8f20-9e30524fc50d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:37.589168 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f072a6f8-f294-40b2-8f20-9e30524fc50d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:37.590086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f072a6f8-f294-40b2-8f20-9e30524fc50d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:37.591147 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f072a6f8-f294-40b2-8f20-9e30524fc50d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:37.591567 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f072a6f8-f294-40b2-8f20-9e30524fc50d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:37.623515 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f072a6f8-f294-40b2-8f20-9e30524fc50d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:37.624001 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f072a6f8-f294-40b2-8f20-9e30524fc50d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:37.624474 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-f072a6f8-f294-40b2-8f20-9e30524fc50d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:37.624918 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.objects.instance [None req-f072a6f8-f294-40b2-8f20-9e30524fc50d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lazy-loading 'fault' on Instance uuid 3a8e9668-965e-444d-87c1-5fe36bc3b0ab {{(pid=119146) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:42:37.665467 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-f072a6f8-f294-40b2-8f20-9e30524fc50d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdf62fbe49d44a58c294ac2c8b22ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d41e46b7e3415684c32b22f31eefb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:37.673673 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-f072a6f8-f294-40b2-8f20-9e30524fc50d tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 200 len: 1230 microversion: 2.1 time: 0.097888 Oct 24 13:42:37.674246 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 663/1327] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:37 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:38.702729 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-79743a57-9309-4860-9928-53b982e61914 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:38.703430 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-79743a57-9309-4860-9928-53b982e61914 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 3a8e9668-965e-444d-87c1-5fe36bc3b0ab] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:38.709608 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-79743a57-9309-4860-9928-53b982e61914 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:38.710083 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-79743a57-9309-4860-9928-53b982e61914 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:38.710516 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-79743a57-9309-4860-9928-53b982e61914 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:38.711200 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-79743a57-9309-4860-9928-53b982e61914 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:38.711647 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-79743a57-9309-4860-9928-53b982e61914 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:38.712068 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-79743a57-9309-4860-9928-53b982e61914 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:38.725626 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-79743a57-9309-4860-9928-53b982e61914 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] HTTP exception thrown: Instance 3a8e9668-965e-444d-87c1-5fe36bc3b0ab could not be found. Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-79743a57-9309-4860-9928-53b982e61914 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Request method failure captured: Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab HTTP/1.1 Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpRbhxdELZc_i7DhRs5HUpO2Kh4fAQXjI9jJyU_R-Dsn6Pa4_WBn9qUrvbf3M8ir7YbciC6xRkl42wHqEUd0Mf-3NluUUfDljmG9smj9tmXhbdwN90uixbTLb22N61tZT9VccVcNcLOqcQFqYmYP3u5lK5kBhSxDok0TbgxsEmsFoBs Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: 46d41e46b7e3415684c32b22f31eefb5 Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-TestVolumeBootPattern-331217562 Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:42:38.727240 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:42:38.729113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_46d41e46b7e3415684c32b22f31eefb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46d41e46b7e3415684c32b22f31eefb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46d41e46b7e3415684c32b22f31eefb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/46d41e46b7e3415684c32b22f31eefb5"}]}] Oct 24 13:42:38.729113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-TestVolumeBootPattern-331217562 Oct 24 13:42:38.729113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: 46d41e46b7e3415684c32b22f31eefb5 Oct 24 13:42:38.729113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-TestVolumeBootPattern-331217562 Oct 24 13:42:38.729113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-TestVolumeBootPattern-331217562-project Oct 24 13:42:38.729113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:42:38.729113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:42:38.729113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: cbdf62fbe49d44a58c294ac2c8b22ef5 Oct 24 13:42:38.729113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-TestVolumeBootPattern-331217562-project Oct 24 13:42:38.729113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:42:38.729113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance 3a8e9668-965e-444d-87c1-5fe36bc3b0ab could not be found. Oct 24 13:42:38.729113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': '3a8e9668-965e-444d-87c1-5fe36bc3b0ab'} Oct 24 13:42:38.730193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:42:38.730193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:42:38.730193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:42:38.730193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:42:38.730193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:42:38.730193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:42:38.730193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:42:38.730193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:42:38.730193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:42:38.730193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:42:38.730193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8e9668-965e-444d-87c1-5fe36bc3b0ab could not be found. Oct 24 13:42:38.730193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:42:38.730193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:42:38.730193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:42:38.730193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:42:38.730193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:42:38.730193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:42:38.730193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:42:38.730193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:42:38.730193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:42:38.731879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:42:38.731879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:42:38.731879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:42:38.731879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:42:38.731879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:42:38.731879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:42:38.731879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:42:38.731879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8e9668-965e-444d-87c1-5fe36bc3b0ab could not be found. Oct 24 13:42:38.731879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:42:38.731879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:42:38.731879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:42:38.731879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:42:38.731879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:42:38.731879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:42:38.731879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:42:38.731879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:42:38.731879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8e9668-965e-444d-87c1-5fe36bc3b0ab could not be found. Oct 24 13:42:38.731879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:42:38.733468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-79743a57-9309-4860-9928-53b982e61914 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Returning 404 to user: Instance 3a8e9668-965e-444d-87c1-5fe36bc3b0ab could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:42:38.733468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-79743a57-9309-4860-9928-53b982e61914 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab" status: 404 len: 111 microversion: 2.1 time: 0.030769 Oct 24 13:42:38.733468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 665/1328] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:38 2022] GET /compute/v2.1/servers/3a8e9668-965e-444d-87c1-5fe36bc3b0ab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:42:39.266381 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9b77dbd5-a727-46ce-8951-ec09414a2157 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:39.266909 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-9b77dbd5-a727-46ce-8951-ec09414a2157 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:39.273385 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9b77dbd5-a727-46ce-8951-ec09414a2157 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:39.273855 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9b77dbd5-a727-46ce-8951-ec09414a2157 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:39.274282 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9b77dbd5-a727-46ce-8951-ec09414a2157 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:39.274952 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9b77dbd5-a727-46ce-8951-ec09414a2157 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:39.275399 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9b77dbd5-a727-46ce-8951-ec09414a2157 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:39.275813 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-9b77dbd5-a727-46ce-8951-ec09414a2157 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:39.288642 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-9b77dbd5-a727-46ce-8951-ec09414a2157 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] HTTP exception thrown: Instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b could not be found. Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9b77dbd5-a727-46ce-8951-ec09414a2157 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Request method failure captured: Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: DELETE /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b HTTP/1.1 Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpRbhxdELZc_i7DhRs5HUpO2Kh4fAQXjI9jJyU_R-Dsn6Pa4_WBn9qUrvbf3M8ir7YbciC6xRkl42wHqEUd0Mf-3NluUUfDljmG9smj9tmXhbdwN90uixbTLb22N61tZT9VccVcNcLOqcQFqYmYP3u5lK5kBhSxDok0TbgxsEmsFoBs Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 46d41e46b7e3415684c32b22f31eefb5 Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-TestVolumeBootPattern-331217562 Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:42:39.290255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:42:39.292030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_46d41e46b7e3415684c32b22f31eefb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46d41e46b7e3415684c32b22f31eefb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46d41e46b7e3415684c32b22f31eefb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/46d41e46b7e3415684c32b22f31eefb5"}]}] Oct 24 13:42:39.292030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-TestVolumeBootPattern-331217562 Oct 24 13:42:39.292030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 46d41e46b7e3415684c32b22f31eefb5 Oct 24 13:42:39.292030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-TestVolumeBootPattern-331217562 Oct 24 13:42:39.292030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-TestVolumeBootPattern-331217562-project Oct 24 13:42:39.292030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:42:39.292030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:42:39.292030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: cbdf62fbe49d44a58c294ac2c8b22ef5 Oct 24 13:42:39.292030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-TestVolumeBootPattern-331217562-project Oct 24 13:42:39.292030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:42:39.292030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b could not be found. Oct 24 13:42:39.292030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': '5762454b-33e1-445d-a5e5-be0b4ba78d7b'} Oct 24 13:42:39.294832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:42:39.294832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:42:39.294832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:42:39.294832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:42:39.294832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:42:39.294832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:42:39.294832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:42:39.294832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:42:39.294832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:42:39.294832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:42:39.294832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b could not be found. Oct 24 13:42:39.294832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:42:39.294832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:42:39.294832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:42:39.294832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:42:39.294832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:42:39.294832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:42:39.294832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:42:39.294832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:42:39.294832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:42:39.296447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:42:39.296447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:42:39.296447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:42:39.296447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:42:39.296447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:42:39.296447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:42:39.296447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:42:39.296447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:42:39.296447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:42:39.296447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b could not be found. Oct 24 13:42:39.296447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:42:39.296447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:42:39.296447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:42:39.296447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:42:39.296447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:42:39.296447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:42:39.296447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:42:39.296447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:42:39.296447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b could not be found. Oct 24 13:42:39.296447 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:42:39.298092 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-9b77dbd5-a727-46ce-8951-ec09414a2157 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Returning 404 to user: Instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:42:39.298092 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-9b77dbd5-a727-46ce-8951-ec09414a2157 tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 404 len: 111 microversion: 2.1 time: 0.029778 Oct 24 13:42:39.298092 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 664/1329] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:42:39 2022] DELETE /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:42:39.300029 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-2f5f3328-a011-47ba-bceb-09bb8fc806dd tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:39.300663 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-2f5f3328-a011-47ba-bceb-09bb8fc806dd tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] [instance: 5762454b-33e1-445d-a5e5-be0b4ba78d7b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:39.306555 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2f5f3328-a011-47ba-bceb-09bb8fc806dd tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:39.307057 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2f5f3328-a011-47ba-bceb-09bb8fc806dd tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:39.307482 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2f5f3328-a011-47ba-bceb-09bb8fc806dd tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:39.308158 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2f5f3328-a011-47ba-bceb-09bb8fc806dd tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:39.308641 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2f5f3328-a011-47ba-bceb-09bb8fc806dd tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:39.309569 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-2f5f3328-a011-47ba-bceb-09bb8fc806dd tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:39.322755 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-2f5f3328-a011-47ba-bceb-09bb8fc806dd tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] HTTP exception thrown: Instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b could not be found. Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-2f5f3328-a011-47ba-bceb-09bb8fc806dd tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Request method failure captured: Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b HTTP/1.1 Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpRbhxdELZc_i7DhRs5HUpO2Kh4fAQXjI9jJyU_R-Dsn6Pa4_WBn9qUrvbf3M8ir7YbciC6xRkl42wHqEUd0Mf-3NluUUfDljmG9smj9tmXhbdwN90uixbTLb22N61tZT9VccVcNcLOqcQFqYmYP3u5lK5kBhSxDok0TbgxsEmsFoBs Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: 46d41e46b7e3415684c32b22f31eefb5 Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-TestVolumeBootPattern-331217562 Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:42:39.324256 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:42:39.326674 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_46d41e46b7e3415684c32b22f31eefb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46d41e46b7e3415684c32b22f31eefb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46d41e46b7e3415684c32b22f31eefb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/46d41e46b7e3415684c32b22f31eefb5"}]}] Oct 24 13:42:39.326674 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-TestVolumeBootPattern-331217562 Oct 24 13:42:39.326674 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: 46d41e46b7e3415684c32b22f31eefb5 Oct 24 13:42:39.326674 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-TestVolumeBootPattern-331217562 Oct 24 13:42:39.326674 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-TestVolumeBootPattern-331217562-project Oct 24 13:42:39.326674 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:42:39.326674 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:42:39.326674 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: cbdf62fbe49d44a58c294ac2c8b22ef5 Oct 24 13:42:39.326674 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-TestVolumeBootPattern-331217562-project Oct 24 13:42:39.326674 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:42:39.326674 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b could not be found. Oct 24 13:42:39.326674 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': '5762454b-33e1-445d-a5e5-be0b4ba78d7b'} Oct 24 13:42:39.327665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:42:39.327665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:42:39.327665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:42:39.327665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:42:39.327665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:42:39.327665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:42:39.327665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:42:39.327665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:42:39.327665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:42:39.327665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:42:39.327665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b could not be found. Oct 24 13:42:39.327665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:42:39.327665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:42:39.327665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:42:39.327665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:42:39.327665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:42:39.327665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:42:39.327665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:42:39.327665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:42:39.327665 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:42:39.329390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:42:39.329390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:42:39.329390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:42:39.329390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:42:39.329390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:42:39.329390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:42:39.329390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:42:39.329390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b could not be found. Oct 24 13:42:39.329390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:42:39.329390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:42:39.329390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:42:39.329390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:42:39.329390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:42:39.329390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:42:39.329390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:42:39.329390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:42:39.329390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b could not be found. Oct 24 13:42:39.329390 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:42:39.330815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-2f5f3328-a011-47ba-bceb-09bb8fc806dd tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Returning 404 to user: Instance 5762454b-33e1-445d-a5e5-be0b4ba78d7b could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:42:39.330815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-2f5f3328-a011-47ba-bceb-09bb8fc806dd tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b" status: 404 len: 111 microversion: 2.1 time: 0.029976 Oct 24 13:42:39.330815 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 666/1330] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:39 2022] GET /compute/v2.1/servers/5762454b-33e1-445d-a5e5-be0b4ba78d7b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:42:40.847390 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-2b6618be-cfff-4f1f-8401-bd41cce68eee tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] Calling method '.version_select at 0x7f17a81ff550>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:40.928953 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-2b6618be-cfff-4f1f-8401-bd41cce68eee tempest-TestVolumeBootPattern-331217562 tempest-TestVolumeBootPattern-331217562-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-827635155" status: 202 len: 0 microversion: 2.1 time: 0.085548 Oct 24 13:42:40.929623 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 665/1331] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Oct 24 13:42:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-827635155 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:43:26.797987 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-e9f25f07-1e40-433c-9eba-90bfbd6a4b36 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:26.798497 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-e9f25f07-1e40-433c-9eba-90bfbd6a4b36 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:26.801460 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=2 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:26.802104 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:26.807432 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e9f25f07-1e40-433c-9eba-90bfbd6a4b36 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:26.809421 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e9f25f07-1e40-433c-9eba-90bfbd6a4b36 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:26.809421 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e9f25f07-1e40-433c-9eba-90bfbd6a4b36 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:26.809421 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e9f25f07-1e40-433c-9eba-90bfbd6a4b36 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:26.809421 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e9f25f07-1e40-433c-9eba-90bfbd6a4b36 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:26.809868 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-e9f25f07-1e40-433c-9eba-90bfbd6a4b36 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:26.835523 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-e9f25f07-1e40-433c-9eba-90bfbd6a4b36 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8/ips" status: 200 len: 149 microversion: 2.1 time: 0.041445 Oct 24 13:43:26.838103 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 667/1332] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 24 13:43:26 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:43:28.361543 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=36 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:28.362227 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:28.363002 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 13:43:28.363151 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Mon Oct 24 13:43:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8/os-volume_attachments (ip 10.222.0.48) !!! Oct 24 13:43:28.368018 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-19e644df-c0fd-4ccc-8d3c-f7cdb0e37f1c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f6d0c9e-b8cb-4273-8a4b-ab2fd9a21556"}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:43:28.389991 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-19e644df-c0fd-4ccc-8d3c-f7cdb0e37f1c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:28.389991 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-19e644df-c0fd-4ccc-8d3c-f7cdb0e37f1c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:28.389991 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-19e644df-c0fd-4ccc-8d3c-f7cdb0e37f1c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:28.389991 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-19e644df-c0fd-4ccc-8d3c-f7cdb0e37f1c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:28.390426 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-19e644df-c0fd-4ccc-8d3c-f7cdb0e37f1c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:28.390426 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-19e644df-c0fd-4ccc-8d3c-f7cdb0e37f1c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:28.390426 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-19e644df-c0fd-4ccc-8d3c-f7cdb0e37f1c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:28.987724 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-19e644df-c0fd-4ccc-8d3c-f7cdb0e37f1c tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "POST /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.627418 Oct 24 13:43:28.988346 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 666/1333] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 24 13:43:28 2022] POST /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8/os-volume_attachments => generated 194 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:43:36.619606 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-1ed97adb-e1ab-4776-85e4-aa16dc610499 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:36.620133 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-1ed97adb-e1ab-4776-85e4-aa16dc610499 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:36.627385 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ed97adb-e1ab-4776-85e4-aa16dc610499 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:36.627856 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ed97adb-e1ab-4776-85e4-aa16dc610499 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:36.628307 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ed97adb-e1ab-4776-85e4-aa16dc610499 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:36.632633 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ed97adb-e1ab-4776-85e4-aa16dc610499 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:36.632633 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ed97adb-e1ab-4776-85e4-aa16dc610499 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:36.632633 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-1ed97adb-e1ab-4776-85e4-aa16dc610499 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:36.712732 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.objects.instance [None req-1ed97adb-e1ab-4776-85e4-aa16dc610499 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lazy-loading 'services' on Instance uuid fb9098c2-59fd-40de-8d8a-e326307949d8 {{(pid=119145) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:43:36.880403 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-1ed97adb-e1ab-4776-85e4-aa16dc610499 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8/os-volume_attachments/2f6d0c9e-b8cb-4273-8a4b-ab2fd9a21556" status: 202 len: 0 microversion: 2.1 time: 0.265195 Oct 24 13:43:36.886817 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 668/1334] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 24 13:43:36 2022] DELETE /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8/os-volume_attachments/2f6d0c9e-b8cb-4273-8a4b-ab2fd9a21556 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:43:36.890248 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8bf95e59-4341-40cf-bd5e-3c0197a3812a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:36.892600 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8bf95e59-4341-40cf-bd5e-3c0197a3812a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:36.899803 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8bf95e59-4341-40cf-bd5e-3c0197a3812a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:36.900295 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8bf95e59-4341-40cf-bd5e-3c0197a3812a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:36.900781 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8bf95e59-4341-40cf-bd5e-3c0197a3812a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:36.901463 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8bf95e59-4341-40cf-bd5e-3c0197a3812a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:36.901904 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8bf95e59-4341-40cf-bd5e-3c0197a3812a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:36.902315 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-8bf95e59-4341-40cf-bd5e-3c0197a3812a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:36.931777 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8bf95e59-4341-40cf-bd5e-3c0197a3812a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046021 Oct 24 13:43:36.932263 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 667/1335] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 24 13:43:36 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:43:37.945785 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-af9f4102-9f50-4515-b64f-e3b992059ccb tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:37.948130 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-af9f4102-9f50-4515-b64f-e3b992059ccb tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:37.954726 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-af9f4102-9f50-4515-b64f-e3b992059ccb tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:37.955195 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-af9f4102-9f50-4515-b64f-e3b992059ccb tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:37.955617 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-af9f4102-9f50-4515-b64f-e3b992059ccb tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:37.956989 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-af9f4102-9f50-4515-b64f-e3b992059ccb tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:37.957438 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-af9f4102-9f50-4515-b64f-e3b992059ccb tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:37.957869 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-af9f4102-9f50-4515-b64f-e3b992059ccb tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:37.986297 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-af9f4102-9f50-4515-b64f-e3b992059ccb tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045882 Oct 24 13:43:37.986839 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 669/1336] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 24 13:43:37 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:43:38.051106 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-852841b2-720f-418c-b8d1-8e7c6b0d364d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:38.051623 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-852841b2-720f-418c-b8d1-8e7c6b0d364d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:38.058108 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-852841b2-720f-418c-b8d1-8e7c6b0d364d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:38.058593 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-852841b2-720f-418c-b8d1-8e7c6b0d364d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:38.059026 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-852841b2-720f-418c-b8d1-8e7c6b0d364d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:38.059716 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-852841b2-720f-418c-b8d1-8e7c6b0d364d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:38.060171 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-852841b2-720f-418c-b8d1-8e7c6b0d364d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:38.060627 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-852841b2-720f-418c-b8d1-8e7c6b0d364d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:38.091199 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-852841b2-720f-418c-b8d1-8e7c6b0d364d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Going to try to terminate instance {{(pid=119146) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:43:38.354736 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-852841b2-720f-418c-b8d1-8e7c6b0d364d tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 204 len: 0 microversion: 2.1 time: 0.307452 Oct 24 13:43:38.355281 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 668/1337] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:43:38 2022] DELETE /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:43:38.364113 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-6038fc6b-aae3-4d74-8525-3a619b900498 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:38.364793 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-6038fc6b-aae3-4d74-8525-3a619b900498 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:38.370726 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6038fc6b-aae3-4d74-8525-3a619b900498 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:38.371193 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6038fc6b-aae3-4d74-8525-3a619b900498 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:38.371622 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6038fc6b-aae3-4d74-8525-3a619b900498 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:38.372319 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6038fc6b-aae3-4d74-8525-3a619b900498 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:38.372768 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6038fc6b-aae3-4d74-8525-3a619b900498 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:38.373185 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-6038fc6b-aae3-4d74-8525-3a619b900498 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:38.500421 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-6038fc6b-aae3-4d74-8525-3a619b900498 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:38.508233 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-6038fc6b-aae3-4d74-8525-3a619b900498 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 200 len: 1679 microversion: 2.1 time: 0.148583 Oct 24 13:43:38.508875 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 670/1338] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:38 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:39.531485 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-a0962f07-81cb-4a46-ab4a-5a105eaf8467 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:39.532192 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-a0962f07-81cb-4a46-ab4a-5a105eaf8467 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:39.539293 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a0962f07-81cb-4a46-ab4a-5a105eaf8467 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:39.539763 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a0962f07-81cb-4a46-ab4a-5a105eaf8467 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:39.540186 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a0962f07-81cb-4a46-ab4a-5a105eaf8467 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:39.540890 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a0962f07-81cb-4a46-ab4a-5a105eaf8467 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:39.541353 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a0962f07-81cb-4a46-ab4a-5a105eaf8467 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:39.541748 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-a0962f07-81cb-4a46-ab4a-5a105eaf8467 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:39.671386 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-a0962f07-81cb-4a46-ab4a-5a105eaf8467 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:39.679097 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-a0962f07-81cb-4a46-ab4a-5a105eaf8467 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 200 len: 1679 microversion: 2.1 time: 0.151868 Oct 24 13:43:39.679667 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 669/1339] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:39 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:40.702599 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-94883f27-29df-4cb3-8659-2ce6ad130ed4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:40.703210 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-94883f27-29df-4cb3-8659-2ce6ad130ed4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:40.710338 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-94883f27-29df-4cb3-8659-2ce6ad130ed4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:40.710812 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-94883f27-29df-4cb3-8659-2ce6ad130ed4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:40.711242 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-94883f27-29df-4cb3-8659-2ce6ad130ed4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:40.711929 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-94883f27-29df-4cb3-8659-2ce6ad130ed4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:40.712402 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-94883f27-29df-4cb3-8659-2ce6ad130ed4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:40.712826 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-94883f27-29df-4cb3-8659-2ce6ad130ed4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:40.796707 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-94883f27-29df-4cb3-8659-2ce6ad130ed4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:40.805652 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-94883f27-29df-4cb3-8659-2ce6ad130ed4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 200 len: 1612 microversion: 2.1 time: 0.106452 Oct 24 13:43:40.805965 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 671/1340] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:40 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 1612 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:41.080996 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-807b45d8-cc3f-4281-83ec-0c448c93bb98 req-51da8809-785e-4164-8c30-9f2426b1fc2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb9098c2-59fd-40de-8d8a-e326307949d8", "name": "network-vif-deleted", "tag": "f9a14a79-1a72-49eb-9f40-e0e7455d83ef"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:43:41.091530 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-807b45d8-cc3f-4281-83ec-0c448c93bb98 req-51da8809-785e-4164-8c30-9f2426b1fc2a service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:41.092016 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-807b45d8-cc3f-4281-83ec-0c448c93bb98 req-51da8809-785e-4164-8c30-9f2426b1fc2a service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:41.092487 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-807b45d8-cc3f-4281-83ec-0c448c93bb98 req-51da8809-785e-4164-8c30-9f2426b1fc2a service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:41.104836 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-807b45d8-cc3f-4281-83ec-0c448c93bb98 req-51da8809-785e-4164-8c30-9f2426b1fc2a service nova] Creating event network-vif-deleted:f9a14a79-1a72-49eb-9f40-e0e7455d83ef for instance fb9098c2-59fd-40de-8d8a-e326307949d8 on hv-cinder-86249 Oct 24 13:43:41.110097 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-807b45d8-cc3f-4281-83ec-0c448c93bb98 req-51da8809-785e-4164-8c30-9f2426b1fc2a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032563 Oct 24 13:43:41.110741 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 670/1341] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:43:41.829380 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-ac75e87a-0716-498a-a3ac-546e92813515 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:41.830112 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-ac75e87a-0716-498a-a3ac-546e92813515 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:41.837069 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ac75e87a-0716-498a-a3ac-546e92813515 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:41.837541 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ac75e87a-0716-498a-a3ac-546e92813515 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:41.837973 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ac75e87a-0716-498a-a3ac-546e92813515 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:41.838653 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ac75e87a-0716-498a-a3ac-546e92813515 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:41.839278 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ac75e87a-0716-498a-a3ac-546e92813515 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:41.839690 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ac75e87a-0716-498a-a3ac-546e92813515 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:41.872544 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ac75e87a-0716-498a-a3ac-546e92813515 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:41.873023 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ac75e87a-0716-498a-a3ac-546e92813515 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:41.873447 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-ac75e87a-0716-498a-a3ac-546e92813515 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:41.873882 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.objects.instance [None req-ac75e87a-0716-498a-a3ac-546e92813515 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lazy-loading 'fault' on Instance uuid fb9098c2-59fd-40de-8d8a-e326307949d8 {{(pid=119145) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:43:41.920958 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-ac75e87a-0716-498a-a3ac-546e92813515 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fcced6d8d943608b940d1dab001540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7896472f034eb4b3b028d528cfbac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:41.929327 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-ac75e87a-0716-498a-a3ac-546e92813515 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 200 len: 1330 microversion: 2.1 time: 0.103835 Oct 24 13:43:41.929912 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 672/1342] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:41 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:42.953553 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-717636fe-7005-446b-81a7-98e30a26fb72 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:42.954255 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-717636fe-7005-446b-81a7-98e30a26fb72 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:42.961002 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-717636fe-7005-446b-81a7-98e30a26fb72 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:42.961476 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-717636fe-7005-446b-81a7-98e30a26fb72 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:42.961940 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-717636fe-7005-446b-81a7-98e30a26fb72 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:42.962618 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-717636fe-7005-446b-81a7-98e30a26fb72 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:42.963066 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-717636fe-7005-446b-81a7-98e30a26fb72 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:42.963484 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-717636fe-7005-446b-81a7-98e30a26fb72 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:42.976710 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-717636fe-7005-446b-81a7-98e30a26fb72 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] HTTP exception thrown: Instance fb9098c2-59fd-40de-8d8a-e326307949d8 could not be found. Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-717636fe-7005-446b-81a7-98e30a26fb72 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Request method failure captured: Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 HTTP/1.1 Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpTbRRXQSAKwonVGeChkQxnwDI7hnY-9OBoe_qnbtdeMF_9XlbOZKw0JbfEXuhVi4scmDs_GUKvJoTXwlczS-zmtlXzqna6piOiITjfrb2p2E7hfxVXwAjE0Dt7XmIWSB362Q5Fsw_cewEhIEFbVblBQ6zgqJNdaeZDZqts2BcPdRJc Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:43:42.978291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:43:42.980135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0a7896472f034eb4b3b028d528cfbac0"}]}] Oct 24 13:43:42.980135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:42.980135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:43:42.980135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:42.980135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:43:42.980135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:43:42.980135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:43:42.980135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 54fcced6d8d943608b940d1dab001540 Oct 24 13:43:42.980135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:43:42.980135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:43:42.980135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Instance fb9098c2-59fd-40de-8d8a-e326307949d8 could not be found. Oct 24 13:43:42.980135 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': 'fb9098c2-59fd-40de-8d8a-e326307949d8'} Oct 24 13:43:42.981197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:43:42.981197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:42.981197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:43:42.981197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:43:42.981197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:43:42.981197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:43:42.981197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:43:42.981197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:43:42.981197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:43:42.981197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:43:42.981197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb9098c2-59fd-40de-8d8a-e326307949d8 could not be found. Oct 24 13:43:42.981197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:42.981197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:42.981197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:42.981197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:42.981197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:42.981197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:42.981197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:43:42.981197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:43:42.981197 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:43:42.982880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:43:42.982880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:43:42.982880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:43:42.982880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:43:42.982880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:43:42.982880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:43:42.982880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:43:42.982880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb9098c2-59fd-40de-8d8a-e326307949d8 could not be found. Oct 24 13:43:42.982880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:42.982880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:42.982880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:42.982880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:42.982880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:42.982880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:42.982880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:43:42.982880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:43:42.982880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb9098c2-59fd-40de-8d8a-e326307949d8 could not be found. Oct 24 13:43:42.982880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:42.984441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-717636fe-7005-446b-81a7-98e30a26fb72 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Returning 404 to user: Instance fb9098c2-59fd-40de-8d8a-e326307949d8 could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:43:42.984441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-717636fe-7005-446b-81a7-98e30a26fb72 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 404 len: 111 microversion: 2.1 time: 0.030792 Oct 24 13:43:42.984441 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 671/1343] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:42 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:43:42.989069 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-4082cff7-efc8-46aa-a0ae-cb1b8d3d970e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '.version_select at 0x7f17a8db03a0>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:43.064036 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-4082cff7-efc8-46aa-a0ae-cb1b8d3d970e tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-959413542" status: 202 len: 0 microversion: 2.1 time: 0.079479 Oct 24 13:43:43.064643 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 673/1344] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Oct 24 13:43:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-959413542 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:43:45.239594 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-88e12486-ab50-4fb5-b2b4-5bb58947e1f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:45.240088 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-88e12486-ab50-4fb5-b2b4-5bb58947e1f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:45.246344 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-88e12486-ab50-4fb5-b2b4-5bb58947e1f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:45.246821 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-88e12486-ab50-4fb5-b2b4-5bb58947e1f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:45.247249 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-88e12486-ab50-4fb5-b2b4-5bb58947e1f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:45.247933 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-88e12486-ab50-4fb5-b2b4-5bb58947e1f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:45.248410 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-88e12486-ab50-4fb5-b2b4-5bb58947e1f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:45.248832 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-88e12486-ab50-4fb5-b2b4-5bb58947e1f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:45.262253 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-88e12486-ab50-4fb5-b2b4-5bb58947e1f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] HTTP exception thrown: Instance fb9098c2-59fd-40de-8d8a-e326307949d8 could not be found. Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-88e12486-ab50-4fb5-b2b4-5bb58947e1f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Request method failure captured: Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: DELETE /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 HTTP/1.1 Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpTbRRXQSAKwonVGeChkQxnwDI7hnY-9OBoe_qnbtdeMF_9XlbOZKw0JbfEXuhVi4scmDs_GUKvJoTXwlczS-zmtlXzqna6piOiITjfrb2p2E7hfxVXwAjE0Dt7XmIWSB362Q5Fsw_cewEhIEFbVblBQ6zgqJNdaeZDZqts2BcPdRJc Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:43:45.263752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:43:45.265506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0a7896472f034eb4b3b028d528cfbac0"}]}] Oct 24 13:43:45.265506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:45.265506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:43:45.265506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:45.265506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:43:45.265506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:43:45.265506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:43:45.265506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 54fcced6d8d943608b940d1dab001540 Oct 24 13:43:45.265506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:43:45.265506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:43:45.265506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Instance fb9098c2-59fd-40de-8d8a-e326307949d8 could not be found. Oct 24 13:43:45.265506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': 'fb9098c2-59fd-40de-8d8a-e326307949d8'} Oct 24 13:43:45.266494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:43:45.266494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:45.266494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:43:45.266494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:43:45.266494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:43:45.266494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:43:45.266494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:43:45.266494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:43:45.266494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:43:45.266494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:43:45.266494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb9098c2-59fd-40de-8d8a-e326307949d8 could not be found. Oct 24 13:43:45.266494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:45.266494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:45.266494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:45.266494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:45.266494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:45.266494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:45.266494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:43:45.266494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:43:45.266494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:43:45.268099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:43:45.268099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:43:45.268099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:43:45.268099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:43:45.268099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:43:45.268099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:43:45.268099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:43:45.268099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:43:45.268099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:43:45.268099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb9098c2-59fd-40de-8d8a-e326307949d8 could not be found. Oct 24 13:43:45.268099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:45.268099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:45.268099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:45.268099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:45.268099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:45.268099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:45.268099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:43:45.268099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:43:45.268099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb9098c2-59fd-40de-8d8a-e326307949d8 could not be found. Oct 24 13:43:45.268099 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:45.270357 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-88e12486-ab50-4fb5-b2b4-5bb58947e1f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Returning 404 to user: Instance fb9098c2-59fd-40de-8d8a-e326307949d8 could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:43:45.270357 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-88e12486-ab50-4fb5-b2b4-5bb58947e1f4 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 404 len: 111 microversion: 2.1 time: 0.029320 Oct 24 13:43:45.270357 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 672/1345] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:43:45 2022] DELETE /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:43:45.273891 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-05d8a9b4-cf52-4bf5-b7d1-615d68390f12 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:45.274507 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-05d8a9b4-cf52-4bf5-b7d1-615d68390f12 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: fb9098c2-59fd-40de-8d8a-e326307949d8] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:45.281466 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-05d8a9b4-cf52-4bf5-b7d1-615d68390f12 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:45.281938 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-05d8a9b4-cf52-4bf5-b7d1-615d68390f12 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:45.282360 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-05d8a9b4-cf52-4bf5-b7d1-615d68390f12 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:45.283033 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-05d8a9b4-cf52-4bf5-b7d1-615d68390f12 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:45.283485 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-05d8a9b4-cf52-4bf5-b7d1-615d68390f12 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:45.283924 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-05d8a9b4-cf52-4bf5-b7d1-615d68390f12 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:45.296692 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-05d8a9b4-cf52-4bf5-b7d1-615d68390f12 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] HTTP exception thrown: Instance fb9098c2-59fd-40de-8d8a-e326307949d8 could not be found. Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-05d8a9b4-cf52-4bf5-b7d1-615d68390f12 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Request method failure captured: Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 HTTP/1.1 Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpTbRRXQSAKwonVGeChkQxnwDI7hnY-9OBoe_qnbtdeMF_9XlbOZKw0JbfEXuhVi4scmDs_GUKvJoTXwlczS-zmtlXzqna6piOiITjfrb2p2E7hfxVXwAjE0Dt7XmIWSB362Q5Fsw_cewEhIEFbVblBQ6zgqJNdaeZDZqts2BcPdRJc Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:43:45.298333 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:43:45.300059 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0a7896472f034eb4b3b028d528cfbac0"}]}] Oct 24 13:43:45.300059 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:45.300059 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:43:45.300059 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:45.300059 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:43:45.300059 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:43:45.300059 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:43:45.300059 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 54fcced6d8d943608b940d1dab001540 Oct 24 13:43:45.300059 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:43:45.300059 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:43:45.300059 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance fb9098c2-59fd-40de-8d8a-e326307949d8 could not be found. Oct 24 13:43:45.300059 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': 'fb9098c2-59fd-40de-8d8a-e326307949d8'} Oct 24 13:43:45.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:43:45.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:45.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:43:45.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:43:45.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:43:45.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:43:45.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:43:45.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:43:45.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:43:45.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:43:45.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb9098c2-59fd-40de-8d8a-e326307949d8 could not be found. Oct 24 13:43:45.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:43:45.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:45.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:43:45.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:45.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:45.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:45.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:43:45.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:43:45.301079 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:43:45.302658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:43:45.302658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:43:45.302658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:43:45.302658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:43:45.302658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:43:45.302658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:43:45.302658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:43:45.302658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb9098c2-59fd-40de-8d8a-e326307949d8 could not be found. Oct 24 13:43:45.302658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:43:45.302658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:45.302658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:43:45.302658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:45.302658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:45.302658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:45.302658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:43:45.302658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:43:45.302658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb9098c2-59fd-40de-8d8a-e326307949d8 could not be found. Oct 24 13:43:45.302658 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:43:45.304188 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-05d8a9b4-cf52-4bf5-b7d1-615d68390f12 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Returning 404 to user: Instance fb9098c2-59fd-40de-8d8a-e326307949d8 could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:43:45.304188 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-05d8a9b4-cf52-4bf5-b7d1-615d68390f12 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8" status: 404 len: 111 microversion: 2.1 time: 0.029682 Oct 24 13:43:45.304188 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 674/1346] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:45 2022] GET /compute/v2.1/servers/fb9098c2-59fd-40de-8d8a-e326307949d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:43:46.551420 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b681a1d5-30b1-4e99-b5c5-e9b0db58f902 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:46.552229 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b681a1d5-30b1-4e99-b5c5-e9b0db58f902 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:46.558417 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b681a1d5-30b1-4e99-b5c5-e9b0db58f902 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:46.558900 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b681a1d5-30b1-4e99-b5c5-e9b0db58f902 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:46.559330 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b681a1d5-30b1-4e99-b5c5-e9b0db58f902 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:46.560018 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b681a1d5-30b1-4e99-b5c5-e9b0db58f902 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:46.560574 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b681a1d5-30b1-4e99-b5c5-e9b0db58f902 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:46.560996 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b681a1d5-30b1-4e99-b5c5-e9b0db58f902 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:46.574416 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-b681a1d5-30b1-4e99-b5c5-e9b0db58f902 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] HTTP exception thrown: Instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b could not be found. Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b681a1d5-30b1-4e99-b5c5-e9b0db58f902 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Request method failure captured: Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: DELETE /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b HTTP/1.1 Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpTbRRXQSAKwonVGeChkQxnwDI7hnY-9OBoe_qnbtdeMF_9XlbOZKw0JbfEXuhVi4scmDs_GUKvJoTXwlczS-zmtlXzqna6piOiITjfrb2p2E7hfxVXwAjE0Dt7XmIWSB362Q5Fsw_cewEhIEFbVblBQ6zgqJNdaeZDZqts2BcPdRJc Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:43:46.575945 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:43:46.577689 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0a7896472f034eb4b3b028d528cfbac0"}]}] Oct 24 13:43:46.577689 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:46.577689 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:43:46.577689 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:46.577689 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:43:46.577689 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:43:46.577689 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:43:46.577689 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 54fcced6d8d943608b940d1dab001540 Oct 24 13:43:46.577689 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:43:46.577689 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:43:46.577689 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b could not be found. Oct 24 13:43:46.577689 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': '50390c66-fb8d-4e03-96b9-7dfdc674d94b'} Oct 24 13:43:46.578746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:43:46.578746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:46.578746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:43:46.578746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:43:46.578746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:43:46.578746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:43:46.578746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:43:46.578746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:43:46.578746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:43:46.578746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:43:46.578746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b could not be found. Oct 24 13:43:46.578746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:46.578746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:46.578746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:46.578746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:46.578746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:46.578746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:46.578746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:43:46.578746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:43:46.578746 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:43:46.580371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:43:46.580371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:43:46.580371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:43:46.580371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:43:46.580371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:43:46.580371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:43:46.580371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:43:46.580371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:43:46.580371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:43:46.580371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b could not be found. Oct 24 13:43:46.580371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:46.580371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:46.580371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:46.580371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:46.580371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:46.580371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:46.580371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:43:46.580371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:43:46.580371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b could not be found. Oct 24 13:43:46.580371 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:46.582749 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b681a1d5-30b1-4e99-b5c5-e9b0db58f902 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Returning 404 to user: Instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:43:46.582749 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b681a1d5-30b1-4e99-b5c5-e9b0db58f902 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "DELETE /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 404 len: 111 microversion: 2.1 time: 0.029877 Oct 24 13:43:46.582749 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 673/1347] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:43:46 2022] DELETE /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:43:46.586234 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f1974fa7-8ca7-4785-b552-57d98fea905b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:46.586863 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-f1974fa7-8ca7-4785-b552-57d98fea905b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 50390c66-fb8d-4e03-96b9-7dfdc674d94b] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:46.593246 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f1974fa7-8ca7-4785-b552-57d98fea905b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:46.593716 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f1974fa7-8ca7-4785-b552-57d98fea905b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:46.594133 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f1974fa7-8ca7-4785-b552-57d98fea905b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:46.594802 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f1974fa7-8ca7-4785-b552-57d98fea905b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:46.595238 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f1974fa7-8ca7-4785-b552-57d98fea905b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:46.595647 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-f1974fa7-8ca7-4785-b552-57d98fea905b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:46.608996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-f1974fa7-8ca7-4785-b552-57d98fea905b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] HTTP exception thrown: Instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b could not be found. Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f1974fa7-8ca7-4785-b552-57d98fea905b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Request method failure captured: Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b HTTP/1.1 Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpTbRRXQSAKwonVGeChkQxnwDI7hnY-9OBoe_qnbtdeMF_9XlbOZKw0JbfEXuhVi4scmDs_GUKvJoTXwlczS-zmtlXzqna6piOiITjfrb2p2E7hfxVXwAjE0Dt7XmIWSB362Q5Fsw_cewEhIEFbVblBQ6zgqJNdaeZDZqts2BcPdRJc Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:43:46.610468 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:43:46.612176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0a7896472f034eb4b3b028d528cfbac0"}]}] Oct 24 13:43:46.612176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:46.612176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:43:46.612176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:46.612176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:43:46.612176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:43:46.612176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:43:46.612176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 54fcced6d8d943608b940d1dab001540 Oct 24 13:43:46.612176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:43:46.612176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:43:46.612176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b could not be found. Oct 24 13:43:46.612176 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': '50390c66-fb8d-4e03-96b9-7dfdc674d94b'} Oct 24 13:43:46.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:43:46.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:46.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:43:46.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:43:46.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:43:46.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:43:46.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:43:46.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:43:46.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:43:46.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:43:46.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b could not be found. Oct 24 13:43:46.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:43:46.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:46.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:43:46.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:46.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:46.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:46.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:43:46.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:43:46.613241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:43:46.614922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:43:46.614922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:43:46.614922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:43:46.614922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:43:46.614922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:43:46.614922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:43:46.614922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:43:46.614922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b could not be found. Oct 24 13:43:46.614922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:43:46.614922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:46.614922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:43:46.614922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:46.614922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:46.614922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:46.614922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:43:46.614922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:43:46.614922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b could not be found. Oct 24 13:43:46.614922 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:43:46.616440 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-f1974fa7-8ca7-4785-b552-57d98fea905b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Returning 404 to user: Instance 50390c66-fb8d-4e03-96b9-7dfdc674d94b could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:43:46.616440 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-f1974fa7-8ca7-4785-b552-57d98fea905b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b" status: 404 len: 111 microversion: 2.1 time: 0.029384 Oct 24 13:43:46.616440 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 675/1348] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:46 2022] GET /compute/v2.1/servers/50390c66-fb8d-4e03-96b9-7dfdc674d94b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:43:46.620281 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-056ae3e3-a1db-4350-8be7-bc848a89df0a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:46.620794 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-056ae3e3-a1db-4350-8be7-bc848a89df0a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:46.626767 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-056ae3e3-a1db-4350-8be7-bc848a89df0a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:46.627245 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-056ae3e3-a1db-4350-8be7-bc848a89df0a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:46.627678 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-056ae3e3-a1db-4350-8be7-bc848a89df0a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:46.628920 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-056ae3e3-a1db-4350-8be7-bc848a89df0a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:46.629375 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-056ae3e3-a1db-4350-8be7-bc848a89df0a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:46.629797 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-056ae3e3-a1db-4350-8be7-bc848a89df0a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:46.642835 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-056ae3e3-a1db-4350-8be7-bc848a89df0a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] HTTP exception thrown: Instance 69d5d796-9064-416a-9947-0f27ff79e5c0 could not be found. Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-056ae3e3-a1db-4350-8be7-bc848a89df0a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Request method failure captured: Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: DELETE /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 HTTP/1.1 Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpTbRRXQSAKwonVGeChkQxnwDI7hnY-9OBoe_qnbtdeMF_9XlbOZKw0JbfEXuhVi4scmDs_GUKvJoTXwlczS-zmtlXzqna6piOiITjfrb2p2E7hfxVXwAjE0Dt7XmIWSB362Q5Fsw_cewEhIEFbVblBQ6zgqJNdaeZDZqts2BcPdRJc Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:43:46.645551 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:43:46.647297 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0a7896472f034eb4b3b028d528cfbac0"}]}] Oct 24 13:43:46.647297 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:46.647297 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:43:46.647297 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:46.647297 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:43:46.647297 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:43:46.647297 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:43:46.647297 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 54fcced6d8d943608b940d1dab001540 Oct 24 13:43:46.647297 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:43:46.647297 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:43:46.647297 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Instance 69d5d796-9064-416a-9947-0f27ff79e5c0 could not be found. Oct 24 13:43:46.647297 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': '69d5d796-9064-416a-9947-0f27ff79e5c0'} Oct 24 13:43:46.648351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:43:46.648351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:46.648351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:43:46.648351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:43:46.648351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:43:46.648351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:43:46.648351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:43:46.648351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:43:46.648351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:43:46.648351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:43:46.648351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69d5d796-9064-416a-9947-0f27ff79e5c0 could not be found. Oct 24 13:43:46.648351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:46.648351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:46.648351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:46.648351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:46.648351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:46.648351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:46.648351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:43:46.648351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:43:46.648351 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:43:46.650050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:43:46.650050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:43:46.650050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:43:46.650050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:43:46.650050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:43:46.650050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:43:46.650050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:43:46.650050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:43:46.650050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:43:46.650050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69d5d796-9064-416a-9947-0f27ff79e5c0 could not be found. Oct 24 13:43:46.650050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:46.650050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:46.650050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:46.650050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:46.650050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:46.650050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:46.650050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:43:46.650050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:43:46.650050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69d5d796-9064-416a-9947-0f27ff79e5c0 could not be found. Oct 24 13:43:46.650050 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:46.651749 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-056ae3e3-a1db-4350-8be7-bc848a89df0a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Returning 404 to user: Instance 69d5d796-9064-416a-9947-0f27ff79e5c0 could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:43:46.651749 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-056ae3e3-a1db-4350-8be7-bc848a89df0a tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "DELETE /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 404 len: 111 microversion: 2.1 time: 0.030554 Oct 24 13:43:46.651749 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 674/1349] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:43:46 2022] DELETE /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:43:46.655637 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-d33b7c51-90ef-48b3-b4e0-1de974f777f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:46.656241 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-d33b7c51-90ef-48b3-b4e0-1de974f777f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 69d5d796-9064-416a-9947-0f27ff79e5c0] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:46.662102 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d33b7c51-90ef-48b3-b4e0-1de974f777f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:46.662554 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d33b7c51-90ef-48b3-b4e0-1de974f777f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:46.662977 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d33b7c51-90ef-48b3-b4e0-1de974f777f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:46.663641 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d33b7c51-90ef-48b3-b4e0-1de974f777f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:46.664085 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d33b7c51-90ef-48b3-b4e0-1de974f777f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:46.664526 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-d33b7c51-90ef-48b3-b4e0-1de974f777f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:46.677642 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-d33b7c51-90ef-48b3-b4e0-1de974f777f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] HTTP exception thrown: Instance 69d5d796-9064-416a-9947-0f27ff79e5c0 could not be found. Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-d33b7c51-90ef-48b3-b4e0-1de974f777f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Request method failure captured: Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 HTTP/1.1 Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpTbRRXQSAKwonVGeChkQxnwDI7hnY-9OBoe_qnbtdeMF_9XlbOZKw0JbfEXuhVi4scmDs_GUKvJoTXwlczS-zmtlXzqna6piOiITjfrb2p2E7hfxVXwAjE0Dt7XmIWSB362Q5Fsw_cewEhIEFbVblBQ6zgqJNdaeZDZqts2BcPdRJc Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:43:46.679143 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:43:46.680887 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0a7896472f034eb4b3b028d528cfbac0"}]}] Oct 24 13:43:46.680887 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:46.680887 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:43:46.680887 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:46.680887 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:43:46.680887 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:43:46.680887 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:43:46.680887 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 54fcced6d8d943608b940d1dab001540 Oct 24 13:43:46.680887 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:43:46.680887 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:43:46.680887 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance 69d5d796-9064-416a-9947-0f27ff79e5c0 could not be found. Oct 24 13:43:46.680887 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': '69d5d796-9064-416a-9947-0f27ff79e5c0'} Oct 24 13:43:46.681742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:43:46.681742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:46.681742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:43:46.681742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:43:46.681742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:43:46.681742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:43:46.681742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:43:46.681742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:43:46.681742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:43:46.681742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:43:46.681742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69d5d796-9064-416a-9947-0f27ff79e5c0 could not be found. Oct 24 13:43:46.681742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:43:46.681742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:46.681742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:43:46.681742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:46.681742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:46.681742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:46.681742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:43:46.681742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:43:46.681742 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:43:46.683120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:43:46.683120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:43:46.683120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:43:46.683120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:43:46.683120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:43:46.683120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:43:46.683120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:43:46.683120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69d5d796-9064-416a-9947-0f27ff79e5c0 could not be found. Oct 24 13:43:46.683120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:43:46.683120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:46.683120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:43:46.683120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:46.683120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:46.683120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:46.683120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:43:46.683120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:43:46.683120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69d5d796-9064-416a-9947-0f27ff79e5c0 could not be found. Oct 24 13:43:46.683120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:43:46.684436 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-d33b7c51-90ef-48b3-b4e0-1de974f777f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Returning 404 to user: Instance 69d5d796-9064-416a-9947-0f27ff79e5c0 could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:43:46.684436 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-d33b7c51-90ef-48b3-b4e0-1de974f777f0 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0" status: 404 len: 111 microversion: 2.1 time: 0.028635 Oct 24 13:43:46.684436 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 676/1350] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:46 2022] GET /compute/v2.1/servers/69d5d796-9064-416a-9947-0f27ff79e5c0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:43:47.949494 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bc007bac-ef73-4e42-a71e-d2392a92d9a3 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:47.950023 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-bc007bac-ef73-4e42-a71e-d2392a92d9a3 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:47.956290 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bc007bac-ef73-4e42-a71e-d2392a92d9a3 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:47.956789 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bc007bac-ef73-4e42-a71e-d2392a92d9a3 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:47.957223 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bc007bac-ef73-4e42-a71e-d2392a92d9a3 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:47.957909 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bc007bac-ef73-4e42-a71e-d2392a92d9a3 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:47.958364 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bc007bac-ef73-4e42-a71e-d2392a92d9a3 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:47.958786 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-bc007bac-ef73-4e42-a71e-d2392a92d9a3 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:47.971788 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-bc007bac-ef73-4e42-a71e-d2392a92d9a3 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] HTTP exception thrown: Instance 604ec880-17e0-4294-9b1e-b57ce613c990 could not be found. Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bc007bac-ef73-4e42-a71e-d2392a92d9a3 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Request method failure captured: Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: DELETE /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 HTTP/1.1 Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpTbRRXQSAKwonVGeChkQxnwDI7hnY-9OBoe_qnbtdeMF_9XlbOZKw0JbfEXuhVi4scmDs_GUKvJoTXwlczS-zmtlXzqna6piOiITjfrb2p2E7hfxVXwAjE0Dt7XmIWSB362Q5Fsw_cewEhIEFbVblBQ6zgqJNdaeZDZqts2BcPdRJc Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:43:47.973328 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:43:47.975069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0a7896472f034eb4b3b028d528cfbac0"}]}] Oct 24 13:43:47.975069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:47.975069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:43:47.975069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:47.975069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:43:47.975069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:43:47.975069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:43:47.975069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: 54fcced6d8d943608b940d1dab001540 Oct 24 13:43:47.975069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:43:47.975069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:43:47.975069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Instance 604ec880-17e0-4294-9b1e-b57ce613c990 could not be found. Oct 24 13:43:47.975069 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': '604ec880-17e0-4294-9b1e-b57ce613c990'} Oct 24 13:43:47.976204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:43:47.976204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:47.976204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:43:47.976204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:43:47.976204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:43:47.976204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:43:47.976204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:43:47.976204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:43:47.976204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:43:47.976204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:43:47.976204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 604ec880-17e0-4294-9b1e-b57ce613c990 could not be found. Oct 24 13:43:47.976204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:47.976204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:47.976204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:47.976204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:47.976204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:47.976204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:47.976204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:43:47.976204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:43:47.976204 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:43:47.977988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:43:47.977988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:43:47.977988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:43:47.977988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:43:47.977988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:43:47.977988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:43:47.977988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:43:47.977988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:43:47.977988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:43:47.977988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 604ec880-17e0-4294-9b1e-b57ce613c990 could not be found. Oct 24 13:43:47.977988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:47.977988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:47.977988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:47.977988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:47.977988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:47.977988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:47.977988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:43:47.977988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:43:47.977988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 604ec880-17e0-4294-9b1e-b57ce613c990 could not be found. Oct 24 13:43:47.977988 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:43:47.979632 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-bc007bac-ef73-4e42-a71e-d2392a92d9a3 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Returning 404 to user: Instance 604ec880-17e0-4294-9b1e-b57ce613c990 could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:43:47.979632 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-bc007bac-ef73-4e42-a71e-d2392a92d9a3 tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "DELETE /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990" status: 404 len: 111 microversion: 2.1 time: 0.029055 Oct 24 13:43:47.979632 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 675/1351] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:43:47 2022] DELETE /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:43:47.982873 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-5d663506-c664-445f-9331-e8080e27438b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:47.983488 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-5d663506-c664-445f-9331-e8080e27438b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] [instance: 604ec880-17e0-4294-9b1e-b57ce613c990] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:47.990500 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5d663506-c664-445f-9331-e8080e27438b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:47.991010 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5d663506-c664-445f-9331-e8080e27438b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:47.991441 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5d663506-c664-445f-9331-e8080e27438b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:47.992120 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5d663506-c664-445f-9331-e8080e27438b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:47.992600 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5d663506-c664-445f-9331-e8080e27438b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:47.993023 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-5d663506-c664-445f-9331-e8080e27438b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:48.008212 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.wsgi [None req-5d663506-c664-445f-9331-e8080e27438b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] HTTP exception thrown: Instance 604ec880-17e0-4294-9b1e-b57ce613c990 could not be found. Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-5d663506-c664-445f-9331-e8080e27438b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Request method failure captured: Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: request: GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 HTTP/1.1 Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept: application/json Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Accept-Encoding: identity Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Connection: close Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Length: 0 Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Content-Type: application/json Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Host: 10.222.0.48 Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Openstack-System-Scope: None Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: User-Agent: python-urllib3/1.26.12 Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Auth-Token: gAAAAABjVpTbRRXQSAKwonVGeChkQxnwDI7hnY-9OBoe_qnbtdeMF_9XlbOZKw0JbfEXuhVi4scmDs_GUKvJoTXwlczS-zmtlXzqna6piOiITjfrb2p2E7hfxVXwAjE0Dt7XmIWSB362Q5Fsw_cewEhIEFbVblBQ6zgqJNdaeZDZqts2BcPdRJc Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Id: None Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Domain-Name: None Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Identity-Status: Confirmed Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Is-Admin-Project: True Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Id: default Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Domain-Name: Default Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Project-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Role: reader,member Oct 24 13:43:48.009734 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Roles: reader,member Oct 24 13:43:48.011486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a7896472f034eb4b3b028d528cfbac0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0a7896472f034eb4b3b028d528cfbac0"}]}] Oct 24 13:43:48.011486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:48.011486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Id: 0a7896472f034eb4b3b028d528cfbac0 Oct 24 13:43:48.011486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-598044823 Oct 24 13:43:48.011486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:43:48.011486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Id: default Oct 24 13:43:48.011486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Domain-Name: Default Oct 24 13:43:48.011486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Id: 54fcced6d8d943608b940d1dab001540 Oct 24 13:43:48.011486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: X-User-Name: tempest-AttachVolumeNegativeTest-598044823-project Oct 24 13:43:48.011486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: method: > Oct 24 13:43:48.011486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: exception: Instance 604ec880-17e0-4294-9b1e-b57ce613c990 could not be found. Oct 24 13:43:48.011486 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: action_args: {'id': '604ec880-17e0-4294-9b1e-b57ce613c990'} Oct 24 13:43:48.012654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:43:48.012654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:48.012654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:43:48.012654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:43:48.012654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:43:48.012654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:43:48.012654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:43:48.012654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:43:48.012654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:43:48.012654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:43:48.012654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 604ec880-17e0-4294-9b1e-b57ce613c990 could not be found. Oct 24 13:43:48.012654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:43:48.012654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:48.012654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:43:48.012654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:48.012654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:48.012654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:48.012654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:43:48.012654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:43:48.012654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:43:48.014318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:43:48.014318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:43:48.014318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:43:48.014318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:43:48.014318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:43:48.014318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:43:48.014318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:43:48.014318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 604ec880-17e0-4294-9b1e-b57ce613c990 could not be found. Oct 24 13:43:48.014318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:43:48.014318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:48.014318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:43:48.014318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:48.014318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:48.014318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:48.014318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:43:48.014318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:43:48.014318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 604ec880-17e0-4294-9b1e-b57ce613c990 could not be found. Oct 24 13:43:48.014318 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: ERROR nova.api.openstack.wsgi Oct 24 13:43:48.015914 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-5d663506-c664-445f-9331-e8080e27438b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] Returning 404 to user: Instance 604ec880-17e0-4294-9b1e-b57ce613c990 could not be found. {{(pid=119145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:43:48.015914 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-5d663506-c664-445f-9331-e8080e27438b tempest-AttachVolumeNegativeTest-598044823 tempest-AttachVolumeNegativeTest-598044823-project] 10.222.0.48 "GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990" status: 404 len: 111 microversion: 2.1 time: 0.031999 Oct 24 13:43:48.015914 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 677/1352] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:47 2022] GET /compute/v2.1/servers/604ec880-17e0-4294-9b1e-b57ce613c990 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:45:24.411633 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-fde8c805-3213-4cc2-bf0a-c50bf6881365 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-135426230", "imageRef": "1a874490-179e-412c-895e-52b16935c04c", "flavorRef": "452"}} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:45:24.418937 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:24.419600 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:24.792022 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.network.neutron [None req-fde8c805-3213-4cc2-bf0a-c50bf6881365 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] validate_networks() for None {{(pid=119146) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:45:25.284413 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-fde8c805-3213-4cc2-bf0a-c50bf6881365 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Flavor limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:45:25.284831 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-fde8c805-3213-4cc2-bf0a-c50bf6881365 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Image limits 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:45:25.285296 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-fde8c805-3213-4cc2-bf0a-c50bf6881365 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Flavor pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:45:25.285698 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-fde8c805-3213-4cc2-bf0a-c50bf6881365 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Image pref 0:0:0 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:45:25.286103 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.virt.hardware [None req-fde8c805-3213-4cc2-bf0a-c50bf6881365 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119146) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:45:25.295110 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fde8c805-3213-4cc2-bf0a-c50bf6881365 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:25.295585 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fde8c805-3213-4cc2-bf0a-c50bf6881365 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:25.296011 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fde8c805-3213-4cc2-bf0a-c50bf6881365 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:25.296772 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fde8c805-3213-4cc2-bf0a-c50bf6881365 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:25.297251 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fde8c805-3213-4cc2-bf0a-c50bf6881365 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:25.297668 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fde8c805-3213-4cc2-bf0a-c50bf6881365 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:25.313867 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-fde8c805-3213-4cc2-bf0a-c50bf6881365 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Getting quotas for project 0cf2f5ececed49adb39332338164ec3f. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:45:25.318518 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.quota [None req-fde8c805-3213-4cc2-bf0a-c50bf6881365 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Getting quotas for user a0b551495dca4982bef194a97c707fb5 and project 0cf2f5ececed49adb39332338164ec3f. Resources: {'ram', 'instances', 'cores'} {{(pid=119146) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:45:25.329324 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-fde8c805-3213-4cc2-bf0a-c50bf6881365 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Going to run 1 instances... {{(pid=119146) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:45:25.332249 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-fde8c805-3213-4cc2-bf0a-c50bf6881365 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a874490-179e-412c-895e-52b16935c04c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119146) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:45:25.484736 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-fde8c805-3213-4cc2-bf0a-c50bf6881365 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.077482 Oct 24 13:45:25.485742 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 676/1353] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 24 13:45:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:45:25.494712 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:25.495749 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:25.497112 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 13:45:25.497260 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: Mon Oct 24 13:45:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 (ip 10.222.0.48) !!! Oct 24 13:45:25.501274 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-737dd93e-cf29-489a-88cc-1a8b747f4ce7 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:25.501882 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-737dd93e-cf29-489a-88cc-1a8b747f4ce7 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:25.654104 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-737dd93e-cf29-489a-88cc-1a8b747f4ce7 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b551495dca4982bef194a97c707fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf2f5ececed49adb39332338164ec3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:25.661075 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-737dd93e-cf29-489a-88cc-1a8b747f4ce7 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249" status: 200 len: 1214 microversion: 2.1 time: 0.168482 Oct 24 13:45:25.661641 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 678/1354] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:25 2022] GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 => generated 1214 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:26.683705 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-8f390a69-7f79-424a-9a73-6c02468c98a6 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:26.684341 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-8f390a69-7f79-424a-9a73-6c02468c98a6 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:26.739316 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-8f390a69-7f79-424a-9a73-6c02468c98a6 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b551495dca4982bef194a97c707fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf2f5ececed49adb39332338164ec3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:26.746121 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-8f390a69-7f79-424a-9a73-6c02468c98a6 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249" status: 200 len: 1214 microversion: 2.1 time: 0.066702 Oct 24 13:45:26.746695 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 677/1355] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:26 2022] GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:27.771555 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-fe9e67e2-3985-4fe2-b52d-51b3b848dc1d tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:27.772561 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-fe9e67e2-3985-4fe2-b52d-51b3b848dc1d tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:27.834578 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-fe9e67e2-3985-4fe2-b52d-51b3b848dc1d tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b551495dca4982bef194a97c707fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf2f5ececed49adb39332338164ec3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:27.842046 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-fe9e67e2-3985-4fe2-b52d-51b3b848dc1d tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249" status: 200 len: 1214 microversion: 2.1 time: 0.076989 Oct 24 13:45:27.842634 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 679/1356] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:27 2022] GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:28.865291 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-d71e829f-560d-4d77-a3be-1846b8d1a2ce tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:28.865895 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-d71e829f-560d-4d77-a3be-1846b8d1a2ce tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:28.919209 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-d71e829f-560d-4d77-a3be-1846b8d1a2ce tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b551495dca4982bef194a97c707fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf2f5ececed49adb39332338164ec3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:28.926608 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-d71e829f-560d-4d77-a3be-1846b8d1a2ce tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249" status: 200 len: 1214 microversion: 2.1 time: 0.065736 Oct 24 13:45:28.927176 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 678/1357] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:28 2022] GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:29.949602 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-76a8a8dd-ec4c-49ec-9475-b6fbf9e086c7 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:29.950218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-76a8a8dd-ec4c-49ec-9475-b6fbf9e086c7 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:29.957234 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76a8a8dd-ec4c-49ec-9475-b6fbf9e086c7 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:29.957711 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76a8a8dd-ec4c-49ec-9475-b6fbf9e086c7 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:29.958142 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76a8a8dd-ec4c-49ec-9475-b6fbf9e086c7 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:29.958824 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76a8a8dd-ec4c-49ec-9475-b6fbf9e086c7 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:29.959269 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76a8a8dd-ec4c-49ec-9475-b6fbf9e086c7 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:29.959689 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-76a8a8dd-ec4c-49ec-9475-b6fbf9e086c7 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:30.021218 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-76a8a8dd-ec4c-49ec-9475-b6fbf9e086c7 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b551495dca4982bef194a97c707fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf2f5ececed49adb39332338164ec3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:30.028822 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-76a8a8dd-ec4c-49ec-9475-b6fbf9e086c7 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249" status: 200 len: 1218 microversion: 2.1 time: 0.083097 Oct 24 13:45:30.029391 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 680/1358] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:29 2022] GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:31.052364 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-fb244283-5890-4eb0-a0d5-88d0098095ce tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:31.053030 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-fb244283-5890-4eb0-a0d5-88d0098095ce tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:31.059940 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fb244283-5890-4eb0-a0d5-88d0098095ce tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:31.060451 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fb244283-5890-4eb0-a0d5-88d0098095ce tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:31.060880 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fb244283-5890-4eb0-a0d5-88d0098095ce tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:31.061564 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fb244283-5890-4eb0-a0d5-88d0098095ce tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:31.062022 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fb244283-5890-4eb0-a0d5-88d0098095ce tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:31.062426 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-fb244283-5890-4eb0-a0d5-88d0098095ce tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:31.126331 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-fb244283-5890-4eb0-a0d5-88d0098095ce tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b551495dca4982bef194a97c707fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf2f5ececed49adb39332338164ec3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:31.134706 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-fb244283-5890-4eb0-a0d5-88d0098095ce tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249" status: 200 len: 1266 microversion: 2.1 time: 0.087037 Oct 24 13:45:31.135271 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 679/1359] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:31 2022] GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:32.159037 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-fb851410-9939-43ab-8be8-7b1c0ea070f9 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:32.159643 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-fb851410-9939-43ab-8be8-7b1c0ea070f9 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:32.166230 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb851410-9939-43ab-8be8-7b1c0ea070f9 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:32.166694 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb851410-9939-43ab-8be8-7b1c0ea070f9 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:32.167111 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb851410-9939-43ab-8be8-7b1c0ea070f9 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:32.167781 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb851410-9939-43ab-8be8-7b1c0ea070f9 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:32.168220 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb851410-9939-43ab-8be8-7b1c0ea070f9 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:32.168655 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-fb851410-9939-43ab-8be8-7b1c0ea070f9 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:32.279964 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-fb851410-9939-43ab-8be8-7b1c0ea070f9 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b551495dca4982bef194a97c707fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf2f5ececed49adb39332338164ec3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:32.287654 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-fb851410-9939-43ab-8be8-7b1c0ea070f9 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249" status: 200 len: 1272 microversion: 2.1 time: 0.132982 Oct 24 13:45:32.288227 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 681/1360] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:32 2022] GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:33.310710 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-0cb7200b-244a-4d8b-8dc8-3792d65b8183 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:33.311412 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-0cb7200b-244a-4d8b-8dc8-3792d65b8183 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:33.318766 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0cb7200b-244a-4d8b-8dc8-3792d65b8183 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:33.319243 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0cb7200b-244a-4d8b-8dc8-3792d65b8183 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:33.319667 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0cb7200b-244a-4d8b-8dc8-3792d65b8183 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:33.320380 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0cb7200b-244a-4d8b-8dc8-3792d65b8183 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:33.320834 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0cb7200b-244a-4d8b-8dc8-3792d65b8183 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:33.321290 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-0cb7200b-244a-4d8b-8dc8-3792d65b8183 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:33.452901 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-0cb7200b-244a-4d8b-8dc8-3792d65b8183 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b551495dca4982bef194a97c707fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf2f5ececed49adb39332338164ec3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:33.460241 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-0cb7200b-244a-4d8b-8dc8-3792d65b8183 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249" status: 200 len: 1314 microversion: 2.1 time: 0.153617 Oct 24 13:45:33.460829 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 680/1361] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:33 2022] GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:33.543666 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [req-ba93ff76-d75a-435e-b3bb-975971dafda6 req-1a06f113-9fd2-4541-8a23-6631ffa9279d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a5c65f0-37e5-4571-8002-9211ca741249", "tag": "a8436efd-9471-4000-bb1a-aafe0811b533"}]} {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:45:33.554034 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-ba93ff76-d75a-435e-b3bb-975971dafda6 req-1a06f113-9fd2-4541-8a23-6631ffa9279d service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:33.554494 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-ba93ff76-d75a-435e-b3bb-975971dafda6 req-1a06f113-9fd2-4541-8a23-6631ffa9279d service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:33.555505 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [req-ba93ff76-d75a-435e-b3bb-975971dafda6 req-1a06f113-9fd2-4541-8a23-6631ffa9279d service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:33.566138 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.compute.server_external_events [req-ba93ff76-d75a-435e-b3bb-975971dafda6 req-1a06f113-9fd2-4541-8a23-6631ffa9279d service nova] Creating event network-changed:a8436efd-9471-4000-bb1a-aafe0811b533 for instance 5a5c65f0-37e5-4571-8002-9211ca741249 on hv-cinder-86249 Oct 24 13:45:33.571370 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [req-ba93ff76-d75a-435e-b3bb-975971dafda6 req-1a06f113-9fd2-4541-8a23-6631ffa9279d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031596 Oct 24 13:45:33.577601 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 682/1362] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:45:34.482208 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-38ea14d4-3606-4a88-aafb-9d6f39b4fa82 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:34.482761 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-38ea14d4-3606-4a88-aafb-9d6f39b4fa82 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:34.489691 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-38ea14d4-3606-4a88-aafb-9d6f39b4fa82 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:34.490171 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-38ea14d4-3606-4a88-aafb-9d6f39b4fa82 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:34.490615 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-38ea14d4-3606-4a88-aafb-9d6f39b4fa82 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:34.491296 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-38ea14d4-3606-4a88-aafb-9d6f39b4fa82 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:34.491752 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-38ea14d4-3606-4a88-aafb-9d6f39b4fa82 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:34.492175 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-38ea14d4-3606-4a88-aafb-9d6f39b4fa82 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:34.619740 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-38ea14d4-3606-4a88-aafb-9d6f39b4fa82 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b551495dca4982bef194a97c707fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf2f5ececed49adb39332338164ec3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:34.627350 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-38ea14d4-3606-4a88-aafb-9d6f39b4fa82 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249" status: 200 len: 1314 microversion: 2.1 time: 0.149091 Oct 24 13:45:34.628483 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 681/1363] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:34 2022] GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:35.651907 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-9bf936dc-c1b2-4a7c-9122-00d01195edd3 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:35.652661 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-9bf936dc-c1b2-4a7c-9122-00d01195edd3 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:35.658749 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9bf936dc-c1b2-4a7c-9122-00d01195edd3 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:35.659214 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9bf936dc-c1b2-4a7c-9122-00d01195edd3 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:35.659633 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9bf936dc-c1b2-4a7c-9122-00d01195edd3 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:35.660328 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9bf936dc-c1b2-4a7c-9122-00d01195edd3 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:35.660771 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9bf936dc-c1b2-4a7c-9122-00d01195edd3 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:35.661182 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-9bf936dc-c1b2-4a7c-9122-00d01195edd3 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:35.793424 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-9bf936dc-c1b2-4a7c-9122-00d01195edd3 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b551495dca4982bef194a97c707fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf2f5ececed49adb39332338164ec3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:35.801679 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-9bf936dc-c1b2-4a7c-9122-00d01195edd3 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249" status: 200 len: 1314 microversion: 2.1 time: 0.154545 Oct 24 13:45:35.802245 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 683/1364] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:35 2022] GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:36.824169 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-30bd2ca5-8f56-4cb3-a75a-d61d88a04577 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:36.824750 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-30bd2ca5-8f56-4cb3-a75a-d61d88a04577 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:36.826547 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=2 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:36.832421 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-30bd2ca5-8f56-4cb3-a75a-d61d88a04577 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:36.837215 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-30bd2ca5-8f56-4cb3-a75a-d61d88a04577 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:36.837215 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-30bd2ca5-8f56-4cb3-a75a-d61d88a04577 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:36.837215 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-30bd2ca5-8f56-4cb3-a75a-d61d88a04577 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:36.837215 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-30bd2ca5-8f56-4cb3-a75a-d61d88a04577 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:36.837629 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-30bd2ca5-8f56-4cb3-a75a-d61d88a04577 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:36.967150 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-30bd2ca5-8f56-4cb3-a75a-d61d88a04577 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b551495dca4982bef194a97c707fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf2f5ececed49adb39332338164ec3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:36.975109 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-30bd2ca5-8f56-4cb3-a75a-d61d88a04577 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249" status: 200 len: 1314 microversion: 2.1 time: 0.154789 Oct 24 13:45:36.975793 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 682/1365] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:36 2022] GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:37.998472 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-95d04dd6-4d77-48bb-b5c0-c63ffb056fa0 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:37.999148 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-95d04dd6-4d77-48bb-b5c0-c63ffb056fa0 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:38.001572 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG dbcounter [-] [119145] Writing DB stats nova_cell0:SELECT=4 {{(pid=119145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:38.006324 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-95d04dd6-4d77-48bb-b5c0-c63ffb056fa0 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:38.006797 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-95d04dd6-4d77-48bb-b5c0-c63ffb056fa0 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:38.007223 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-95d04dd6-4d77-48bb-b5c0-c63ffb056fa0 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:38.007904 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-95d04dd6-4d77-48bb-b5c0-c63ffb056fa0 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:38.008386 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-95d04dd6-4d77-48bb-b5c0-c63ffb056fa0 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:38.008808 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-95d04dd6-4d77-48bb-b5c0-c63ffb056fa0 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:38.135683 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-95d04dd6-4d77-48bb-b5c0-c63ffb056fa0 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b551495dca4982bef194a97c707fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf2f5ececed49adb39332338164ec3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:38.143313 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-95d04dd6-4d77-48bb-b5c0-c63ffb056fa0 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249" status: 200 len: 1314 microversion: 2.1 time: 0.148684 Oct 24 13:45:38.143879 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 684/1366] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:37 2022] GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:39.146285 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-79a57058-d45c-426d-afbe-30e6ffea2aaa req-2b4aab38-f9de-4a44-8075-66f726a7fb44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a5c65f0-37e5-4571-8002-9211ca741249", "name": "network-vif-plugged", "status": "completed", "tag": "a8436efd-9471-4000-bb1a-aafe0811b533"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:45:39.151906 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG dbcounter [-] [119146] Writing DB stats nova_cell0:SELECT=10 {{(pid=119146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:39.157223 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-79a57058-d45c-426d-afbe-30e6ffea2aaa req-2b4aab38-f9de-4a44-8075-66f726a7fb44 service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:39.157700 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-79a57058-d45c-426d-afbe-30e6ffea2aaa req-2b4aab38-f9de-4a44-8075-66f726a7fb44 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:39.158130 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-79a57058-d45c-426d-afbe-30e6ffea2aaa req-2b4aab38-f9de-4a44-8075-66f726a7fb44 service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:39.172633 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-b6da1f94-acd0-43a6-88e8-1e57055d2bea tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:39.172633 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-b6da1f94-acd0-43a6-88e8-1e57055d2bea tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:39.173331 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-79a57058-d45c-426d-afbe-30e6ffea2aaa req-2b4aab38-f9de-4a44-8075-66f726a7fb44 service nova] Creating event network-vif-plugged:a8436efd-9471-4000-bb1a-aafe0811b533 for instance 5a5c65f0-37e5-4571-8002-9211ca741249 on hv-cinder-86249 Oct 24 13:45:39.173996 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6da1f94-acd0-43a6-88e8-1e57055d2bea tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:39.174476 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6da1f94-acd0-43a6-88e8-1e57055d2bea tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:39.174976 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6da1f94-acd0-43a6-88e8-1e57055d2bea tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:39.175600 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-79a57058-d45c-426d-afbe-30e6ffea2aaa req-2b4aab38-f9de-4a44-8075-66f726a7fb44 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033574 Oct 24 13:45:39.175735 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6da1f94-acd0-43a6-88e8-1e57055d2bea tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:39.176091 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6da1f94-acd0-43a6-88e8-1e57055d2bea tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:39.176218 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 683/1367] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:45:39.176530 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-b6da1f94-acd0-43a6-88e8-1e57055d2bea tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:39.316297 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-b6da1f94-acd0-43a6-88e8-1e57055d2bea tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b551495dca4982bef194a97c707fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf2f5ececed49adb39332338164ec3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:39.324364 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-b6da1f94-acd0-43a6-88e8-1e57055d2bea tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249" status: 200 len: 1314 microversion: 2.1 time: 0.161122 Oct 24 13:45:39.324946 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 685/1368] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:39 2022] GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:40.349625 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-c8ba5756-d7bf-4124-9992-54c5d6be5dfd tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:40.350245 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-c8ba5756-d7bf-4124-9992-54c5d6be5dfd tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:40.356929 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c8ba5756-d7bf-4124-9992-54c5d6be5dfd tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:40.357407 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c8ba5756-d7bf-4124-9992-54c5d6be5dfd tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:40.357839 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c8ba5756-d7bf-4124-9992-54c5d6be5dfd tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:40.358520 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c8ba5756-d7bf-4124-9992-54c5d6be5dfd tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:40.358973 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c8ba5756-d7bf-4124-9992-54c5d6be5dfd tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:40.359394 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-c8ba5756-d7bf-4124-9992-54c5d6be5dfd tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:40.487024 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-c8ba5756-d7bf-4124-9992-54c5d6be5dfd tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b551495dca4982bef194a97c707fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf2f5ececed49adb39332338164ec3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:40.495961 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-c8ba5756-d7bf-4124-9992-54c5d6be5dfd tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249" status: 200 len: 1314 microversion: 2.1 time: 0.151567 Oct 24 13:45:40.496581 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 684/1369] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:40 2022] GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:41.518805 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-a75f2d1f-de11-46e8-87b3-e86cabde0f28 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:41.519387 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-a75f2d1f-de11-46e8-87b3-e86cabde0f28 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:41.525701 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a75f2d1f-de11-46e8-87b3-e86cabde0f28 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:41.526166 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a75f2d1f-de11-46e8-87b3-e86cabde0f28 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:41.526587 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a75f2d1f-de11-46e8-87b3-e86cabde0f28 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:41.527255 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a75f2d1f-de11-46e8-87b3-e86cabde0f28 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:41.527692 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a75f2d1f-de11-46e8-87b3-e86cabde0f28 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:41.528102 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-a75f2d1f-de11-46e8-87b3-e86cabde0f28 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:41.653635 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-a75f2d1f-de11-46e8-87b3-e86cabde0f28 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b551495dca4982bef194a97c707fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf2f5ececed49adb39332338164ec3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:41.661216 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-a75f2d1f-de11-46e8-87b3-e86cabde0f28 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249" status: 200 len: 1464 microversion: 2.1 time: 0.146243 Oct 24 13:45:41.661777 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 686/1370] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:41 2022] GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 => generated 1464 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:41.707209 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-b8497b85-d240-4a80-a1d8-44f4704fc483 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:41.707774 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b8497b85-d240-4a80-a1d8-44f4704fc483 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:41.714270 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b8497b85-d240-4a80-a1d8-44f4704fc483 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:41.714794 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b8497b85-d240-4a80-a1d8-44f4704fc483 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:41.715234 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b8497b85-d240-4a80-a1d8-44f4704fc483 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:41.715922 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b8497b85-d240-4a80-a1d8-44f4704fc483 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:41.716423 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b8497b85-d240-4a80-a1d8-44f4704fc483 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:41.716850 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-b8497b85-d240-4a80-a1d8-44f4704fc483 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:41.744192 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-b8497b85-d240-4a80-a1d8-44f4704fc483 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Going to try to terminate instance {{(pid=119146) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:45:41.952068 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-b8497b85-d240-4a80-a1d8-44f4704fc483 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249" status: 204 len: 0 microversion: 2.1 time: 0.248414 Oct 24 13:45:41.952695 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 685/1371] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 24 13:45:41 2022] DELETE /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:45:41.960984 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-871ca1de-5609-4f26-9cb5-bf6fc91020c4 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:41.961994 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-871ca1de-5609-4f26-9cb5-bf6fc91020c4 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:41.967752 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-871ca1de-5609-4f26-9cb5-bf6fc91020c4 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:41.968229 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-871ca1de-5609-4f26-9cb5-bf6fc91020c4 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:41.968681 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-871ca1de-5609-4f26-9cb5-bf6fc91020c4 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:41.969392 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-871ca1de-5609-4f26-9cb5-bf6fc91020c4 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:41.969837 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-871ca1de-5609-4f26-9cb5-bf6fc91020c4 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:41.970253 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-871ca1de-5609-4f26-9cb5-bf6fc91020c4 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:42.101381 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-871ca1de-5609-4f26-9cb5-bf6fc91020c4 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b551495dca4982bef194a97c707fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf2f5ececed49adb39332338164ec3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:42.108957 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-871ca1de-5609-4f26-9cb5-bf6fc91020c4 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249" status: 200 len: 1470 microversion: 2.1 time: 0.151853 Oct 24 13:45:42.109521 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 687/1372] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:41 2022] GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:43.132111 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-7904ebac-86d4-4969-826e-50a9509af22e tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:43.132854 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-7904ebac-86d4-4969-826e-50a9509af22e tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:43.139210 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7904ebac-86d4-4969-826e-50a9509af22e tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:43.139692 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7904ebac-86d4-4969-826e-50a9509af22e tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:43.140123 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7904ebac-86d4-4969-826e-50a9509af22e tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:43.140839 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7904ebac-86d4-4969-826e-50a9509af22e tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:43.141289 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7904ebac-86d4-4969-826e-50a9509af22e tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:43.141707 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-7904ebac-86d4-4969-826e-50a9509af22e tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:43.270037 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.policy [None req-7904ebac-86d4-4969-826e-50a9509af22e tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b551495dca4982bef194a97c707fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf2f5ececed49adb39332338164ec3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119146) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:43.277735 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-7904ebac-86d4-4969-826e-50a9509af22e tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249" status: 200 len: 1470 microversion: 2.1 time: 0.150474 Oct 24 13:45:43.278305 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 686/1373] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:43 2022] GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:44.301590 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.api.openstack.wsgi [None req-57815286-a03e-49e0-bad7-ea1532095c8e tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Calling method '>' {{(pid=119145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:44.302200 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.compute.api [None req-57815286-a03e-49e0-bad7-ea1532095c8e tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Fetching instance by UUID {{(pid=119145) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:44.308807 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-57815286-a03e-49e0-bad7-ea1532095c8e tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:44.309880 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-57815286-a03e-49e0-bad7-ea1532095c8e tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:44.309880 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-57815286-a03e-49e0-bad7-ea1532095c8e tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:44.310389 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-57815286-a03e-49e0-bad7-ea1532095c8e tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:44.310834 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-57815286-a03e-49e0-bad7-ea1532095c8e tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:44.311242 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG oslo_concurrency.lockutils [None req-57815286-a03e-49e0-bad7-ea1532095c8e tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:44.317808 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [req-744f2e0f-8680-486c-a5d1-248ed563a467 req-92e81f5b-6a32-4f2b-9eaf-3e027dc686ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a5c65f0-37e5-4571-8002-9211ca741249", "name": "network-vif-deleted", "tag": "a8436efd-9471-4000-bb1a-aafe0811b533"}]} {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:45:44.328414 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-744f2e0f-8680-486c-a5d1-248ed563a467 req-92e81f5b-6a32-4f2b-9eaf-3e027dc686ea service nova] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:44.329162 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-744f2e0f-8680-486c-a5d1-248ed563a467 req-92e81f5b-6a32-4f2b-9eaf-3e027dc686ea service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:44.329658 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [req-744f2e0f-8680-486c-a5d1-248ed563a467 req-92e81f5b-6a32-4f2b-9eaf-3e027dc686ea service nova] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:44.342091 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.compute.server_external_events [req-744f2e0f-8680-486c-a5d1-248ed563a467 req-92e81f5b-6a32-4f2b-9eaf-3e027dc686ea service nova] Creating event network-vif-deleted:a8436efd-9471-4000-bb1a-aafe0811b533 for instance 5a5c65f0-37e5-4571-8002-9211ca741249 on hv-cinder-86249 Oct 24 13:45:44.352380 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [req-744f2e0f-8680-486c-a5d1-248ed563a467 req-92e81f5b-6a32-4f2b-9eaf-3e027dc686ea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033854 Oct 24 13:45:44.352380 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 687/1374] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 24 13:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:45:44.385748 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: DEBUG nova.policy [None req-57815286-a03e-49e0-bad7-ea1532095c8e tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b551495dca4982bef194a97c707fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf2f5ececed49adb39332338164ec3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119145) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:44.393831 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: INFO nova.api.openstack.requestlog [None req-57815286-a03e-49e0-bad7-ea1532095c8e tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249" status: 200 len: 1428 microversion: 2.1 time: 0.096104 Oct 24 13:45:44.400315 dv-cinder-862491-1-iscsi devstack@n-api.service[119145]: [pid: 119145|app: 0|req: 688/1375] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:44 2022] GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 => generated 1428 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:45.418458 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3afa616f-b4ff-43d1-9723-e464a35dc519 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Calling method '>' {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:45.419154 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.compute.api [None req-3afa616f-b4ff-43d1-9723-e464a35dc519 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] [instance: 5a5c65f0-37e5-4571-8002-9211ca741249] Fetching instance by UUID {{(pid=119146) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:45.426388 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3afa616f-b4ff-43d1-9723-e464a35dc519 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:45.426860 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3afa616f-b4ff-43d1-9723-e464a35dc519 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:45.427283 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3afa616f-b4ff-43d1-9723-e464a35dc519 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:45.427958 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3afa616f-b4ff-43d1-9723-e464a35dc519 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Acquiring lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:45.428440 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3afa616f-b4ff-43d1-9723-e464a35dc519 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:45.428855 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG oslo_concurrency.lockutils [None req-3afa616f-b4ff-43d1-9723-e464a35dc519 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Lock "12340954-03b2-46f2-a6e0-59bc7b2721c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:45.442511 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.wsgi [None req-3afa616f-b4ff-43d1-9723-e464a35dc519 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] HTTP exception thrown: Instance 5a5c65f0-37e5-4571-8002-9211ca741249 could not be found. Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3afa616f-b4ff-43d1-9723-e464a35dc519 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Request method failure captured: Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: request: GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 HTTP/1.1 Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept: application/json Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Accept-Encoding: identity Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Connection: close Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Length: 0 Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Content-Type: application/json Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Host: 10.222.0.48 Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: Openstack-System-Scope: None Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: User-Agent: python-urllib3/1.26.12 Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Auth-Token: gAAAAABjVpby-BF24btK_DTRATx1or8PPCvGvWAJugQqNEAK-mJ0PKXwOXFwpfyDGbR2a5AnaqQoEemA3YRGZUnM4WEtl91wMIIGM1rDDXCoCZr_uHa7ldHb9e-JraGxb4GGmrszgZns1VyyO-rQrn3LEsGCgwrn6iCc10zPQayKktcWounxJYE Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Id: None Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Domain-Name: None Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Identity-Status: Confirmed Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Is-Admin-Project: True Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Id: default Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Domain-Name: Default Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Id: 0cf2f5ececed49adb39332338164ec3f Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Project-Name: tempest-VolumesNegativeTest-751486201 Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Role: reader,member Oct 24 13:45:45.444086 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Roles: reader,member Oct 24 13:45:45.445964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0cf2f5ececed49adb39332338164ec3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0cf2f5ececed49adb39332338164ec3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0cf2f5ececed49adb39332338164ec3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0cf2f5ececed49adb39332338164ec3f"}]}] Oct 24 13:45:45.445964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant: tempest-VolumesNegativeTest-751486201 Oct 24 13:45:45.445964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Id: 0cf2f5ececed49adb39332338164ec3f Oct 24 13:45:45.445964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-Tenant-Name: tempest-VolumesNegativeTest-751486201 Oct 24 13:45:45.445964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User: tempest-VolumesNegativeTest-751486201-project Oct 24 13:45:45.445964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Id: default Oct 24 13:45:45.445964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Domain-Name: Default Oct 24 13:45:45.445964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Id: a0b551495dca4982bef194a97c707fb5 Oct 24 13:45:45.445964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: X-User-Name: tempest-VolumesNegativeTest-751486201-project Oct 24 13:45:45.445964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: method: > Oct 24 13:45:45.445964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: exception: Instance 5a5c65f0-37e5-4571-8002-9211ca741249 could not be found. Oct 24 13:45:45.445964 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: action_args: {'id': '5a5c65f0-37e5-4571-8002-9211ca741249'} Oct 24 13:45:45.447080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: {{(pid=119146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:45:45.447080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:45:45.447080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:45:45.447080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:45:45.447080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:45:45.447080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:45:45.447080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:45:45.447080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:45:45.447080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:45:45.447080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:45:45.447080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a5c65f0-37e5-4571-8002-9211ca741249 could not be found. Oct 24 13:45:45.447080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:45:45.447080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:45:45.447080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:45:45.447080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:45:45.447080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:45:45.447080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:45:45.447080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:45:45.447080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:45:45.447080 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:45:45.448954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:45:45.448954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:45:45.448954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:45:45.448954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:45:45.448954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:45:45.448954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:45:45.448954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:45:45.448954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a5c65f0-37e5-4571-8002-9211ca741249 could not be found. Oct 24 13:45:45.448954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:45:45.448954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:45:45.448954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:45:45.448954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:45:45.448954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:45:45.448954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:45:45.448954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:45:45.448954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:45:45.448954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a5c65f0-37e5-4571-8002-9211ca741249 could not be found. Oct 24 13:45:45.448954 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: ERROR nova.api.openstack.wsgi Oct 24 13:45:45.450506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: DEBUG nova.api.openstack.wsgi [None req-3afa616f-b4ff-43d1-9723-e464a35dc519 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] Returning 404 to user: Instance 5a5c65f0-37e5-4571-8002-9211ca741249 could not be found. {{(pid=119146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:45:45.450506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: INFO nova.api.openstack.requestlog [None req-3afa616f-b4ff-43d1-9723-e464a35dc519 tempest-VolumesNegativeTest-751486201 tempest-VolumesNegativeTest-751486201-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249" status: 404 len: 111 microversion: 2.1 time: 0.031265 Oct 24 13:45:45.450506 dv-cinder-862491-1-iscsi devstack@n-api.service[119146]: [pid: 119146|app: 0|req: 688/1376] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:45 2022] GET /compute/v2.1/servers/5a5c65f0-37e5-4571-8002-9211ca741249 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)